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PREFACE 


This  report  has  been  issued  in  two  volumes.  IDA  Paper 
P-1537,  Part  A  (this  volume),  contains  detailed  background 
information  on  DROLS  operations  and  is  intended  primarily  for 
those  readers  who  are  not  so  familiar  with  DROLS.  Part  B  dis¬ 
cusses  the  details  of  the  research  performed  by  IDA  in  response 
to  the  task  statement. 
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I.  INTRODUCTION 


The  Defense  Technical  Information  Center  (DTIC),  under  the 
overall  direction  of  the  Office  of  the  Deputy  Under  Secretary  of 
Defense  (Research  and  Advanced  Technology),  OUSDRE,  operates  a 
DoD-wide  on-line  system  that  provides  remote  interaction  with 
four  major  RDT&E  data  bases.  The  system  was  originally  designed 
in  the  late  1960s  to  provide  secure  access  to  a  computerized  file 
containing  classified  descriptions  of  ongoing  research  efforts. 
This  original  file  of  Work  Unit  Information  System  data  was 
set  up  as  a  management  information  system  (MIS)  intended  to 
help  keep  DoD  managers  informed  about  ongoing  DoD  scientific 
and  technical  projects,  thereby  avoiding  duplication  of  techni¬ 
cal  effort  and  helping  managers  and  research  personnel  to  stay 
knowledgeable  about  rapidly  advancing  science  and  technology  and 
to  borrow  and  use  ideas  from  each  other  that  might  be  relevant 
to  their  projects. 

Once  the  system  was  in  place  and  operating,  it  became  appar¬ 
ent  that  it  could  have  a  much  broader  application  than  the  one 
for  which  it  was  expressly  designed.  Three  data  bases  were  added 
The  Technical  Reports  (TR),  Research  and  Development  Program 
Planning  (PP),  and  Independent  Research  and  Development  (IR&D) 
files.  The  operational  system  became  known  as  the  Defense 
RDT&E  On-Line  System  (DROLS). 

Of  the  four  files  the  TR  file  is  by  far  the  largest,  con¬ 
taining  about  1.3  million  entries.  Also,  as  might  be  expected, 
the  TR  file  is  the  most  frequently  queried.  Although  it  was 
designed  and  constrained  to  protect  a  small  proportion  (about 
10  percent)  of  intrinsically  classified  records,  DROLS  is  now 
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very  different  in  scope  and  intent  from  its  original  implementa¬ 
tion  with  the  work  unit  file.  Because  of  what  seem,  from  this 
time  vantage  point,  to  be  arbitrary  design  decisions,  DROLS  is 
not  compatible  with  any  other  DoD  system  for  electronic  access 
to  or  transfer  of  S&T  information.  DTIC  cannot,  for  instance, 
interface  with  and  utilize  the  computer  resource  sharing  and 
terminal  access  capabilities  of  the  DoD-developed  ARPANET.  It 
cannot  benefit  from  the  many  software  and  hardware  developments 
in  the  ADP  marketplace.  These  deficiencies  are  manifested  by 
high  costs  for  operation,  access  and  enhancement. 

DTIC  has  found  some  ways  of  circumventing  the  original 
limitations  of  DROLS.  This  year,  for  example,  it  has  developed 
software  that  permits  unclassified  users  to  access  unclassified 
fields  that  pertain  to  classified  reports  in  the  file.  In  addi¬ 
tion,  it  is  now  possible  for  low-speed,  asynchronous  dial-up 
terminals  to  access  the  unclassified  DROLS  files.  Since  this 
study  was  started,  these  and  other  improvements  have  been  made 
to  DROLS  that  effectively  enhance  unclassified  users'  capability 
to  obtain  almost  as  much  information  from  the  files  as  cleared 
users.  We  believe  that  DTIC  has  gone  about  as  far  as  it  can  in 
enhancing  the  utility  of  the  unclassified  terminals  while  still 
conforming  to  its  mandate  to  protect  classified  information  by 
releasing  it  only  to  those  who  are  properly  cleared  to  receive 
it.  It  has  been  able  to  accomplish  what  it  has  done  so  far, 
partly  because  only  a  small  portion  of  the  information  on  its 
files  is  classified  and  even  of  those  reports  that  are  clas¬ 
sified,  there  are  a  number  of  fields  such  as  title,  AD  number, 
authors  and  descriptors  that  are  not  classified. 

However,  the  protection  of  this  small  amount  of  classified 
information  complicates  further  improvement  of  the  system.  It 
also  Maintains  the  high  operating  costs  associated  with  secure 
operating  systems. 
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In  October  1979,  during  a  ceremony  commemorating  the  redes¬ 
ignation  of  the  Defense  Documentation  Center  to  Defense  Technical 
Information  Center  (DTIC),  Dr.  Ruth  M.  Davis,  then  the  Deputy 
Under  Secretary  of  Defense  for  Research  and  Engineering  (R&AT) , 
addressed  DTIC  on  the  subject  of  its  role.  Dr.  Davis  said  that 
DTIC  should  expect  to  "work  more  closely  with  R&D  managers  in 
the  Pentagon  and  provide  them  with  technical  and  management  in¬ 
formation."  In  addition,  she  recommended  that  DTIC  "play  a  more 
important  role  in  the  evolution  of  OUSDRE  data  processing  activ¬ 
ities  . . .  and  assisting  and  improving  our  management  information 
systems  as  well."  DTIC  should  "become  part  of  a  community  pro¬ 
viding  internal  and  external  interactive  data  processing  support 
to  OSD."  It  should  have  "R&D  capability  to  take  care  of  its  own 
growing  needs  and  the  requirements  of  the  Defense  STI  program." 
DTIC  in  the  future  will  "contribute  to  the  education  and  train¬ 
ing  of  R&D  managers  in  the  use  of  DTIC  and  other  data  bases  and 
in  generating  a  Federal  Government-wide  information  interchange 
program.  It  will  also  encourage  the  improvement  of  the  quality 
of  technical  reports..."  (Ref.  1). 

In  view  of  these  changes  in  scope  and  intent,  it  seems  rea¬ 
sonable  to  examine  the  purpose  and  priorities  of  DTIC  insofar  as 
they  concern  the  handling  of  classified  information  on-line.  For 
example,  considering  the  latest  developments  in  information  tech¬ 
nology,  would  there  be  a  net  advantage  to  DTIC  and  the  community 
it  serves,  as  well  as  the  Department  of  Defense,  if  DROLS  became 
a  completely  unclassified  system?  What  alternatives  are  avail¬ 
able  to  DTIC  to  supply  the  needs  of  the  community  that  uses  clas¬ 
sified  information,  if  DROLS  were  limited  to  unclassified  in¬ 
formation?  What  alternative  courses  of  action  do  users  have  if 
they  can  no  longer  obtain  classified  citations  from  DTIC  on-line? 

In  this  study  we  have  tried  to  examine  these  questions.  We 
have  had  to  remind  ourselves  continually  that  DROLS  does  not  have 
in  its  banks  much  that  would  be  considered  by  scientists  and  en¬ 
gineers  as  "real"  data.  DROLS  provides  primarily  bibliographic 


information  and  management  information  such  as  who  is  working 
on  what.  DROLS  then  is  really  more  a  source  of  where  to  find 
it  rather  than  of  the  information  and  data  itself.  It  is  not 
the  only  such  source  that  DTIC  provides,  but  it  is  by  far  the 
most  convenient,  time  saving  and  comprehensive  source  of  where 
to  find  it  information  that  DTIC  offers.  Unfortunately,  although 
only  a  small  part  of  this  information  is  classified,  it  is  neces¬ 
sary  that  the  entire  system  be  set  up  to  protect  this  small  pro¬ 
portion  of  classified  information.  Hence,  all  information  that 
goes  out  to  classified  terminals  must  be  encrypted  and  all  such 
terminals  must  be  located  in  appropriate  enclosures  and  attended 
by  properly  cleared  personnel.  In  addition,  strict  controls 
must  be  maintained  on  user  protocols  for  addressing  the  system 
to  ensure  that  users  receive  only  the  information  they  are  sup¬ 
posed  to  receive  as  determined  by  their  security  status  and  need- 
to-know . 

DTIC  asked  IDA  to  provide  an  examination  and  analysis  that 
might  help  to  improve  access  to  DROLS.  Of  particular  interest 
was  the  question  of  whether  DROLS  should  become  a  totally  un¬ 
classified  system,  with  classified  user's  needs  handled  by  some 
other  means.  To  examine  this  question  IDA  was  asked  to  examine 
the  basic  objectives  and  priorities  for  providing  on-line  access 
to  and  communications  of,  relevant  DTIC-stored  Scientific  and 
Technical  Information  (STI).  These  would  support  Defense  RDT&E 
programs  and  also  the  National  science  and  technology  community. 

This  report  describes  the  work  and  results  of  the  IDA 
effort,  which  was  initiated  on  December  10,  1979.  During  the 
course  of  this  work,  DTIC  initiated  a  number  of  enhancements 
of  DROLS  that  improved  considerably  access  by  the  unclassified 
user.  Some  of  these  improvements  came  unexpectedly,  and,  since 
some  of  the  subtasks  were  made  obsolete  by  the  improvements, 
the  original  work  statement  was  revised.  In  this  report  we  have 
attempted  to  indicate  the  work  that  was  accomplished  in  response 
to  the  original  task  statement  as  well  as  to  the  amended  one. 


In  this  part  of  the  report  (Part  A),  we  present  some  of 
the  background  relating  to  DTIC  and  its  mission.  Part  B  (pub¬ 
lished  separately)  will  present  the  details  of  some  research 
that  IDA  performed  to  find  answers  to  the  basic  questions  asked 
in  the  task  statement.  Part  A  of  our  report  contains  consider¬ 
able  detail  that  would  be  of  little  interest  to  the  reader  who 
is  familiar  with  DTIC  operations.  Rather  it  is  intended  for 
those  readers  who  are  not  so  familiar  with  DTIC  operations. 


II.  DEFENSE  TECHNICAL  INFORMATION  CENTER-- 
SERVICES,  GOALS  AND  CAPABILITIES 


A.  INTRODUCTION 

1 .  Purpose 

This  chapter  presents  information  on  DTIC  operations  and 
services,  the  regulatory  basis  for  such  services,  and  some  sta¬ 
tistics  associated  with  the  present  level  of  service  of  DTIC. 
Various  documents  have  been  used  and  in  some  cases  quoted  freely 
without  further  attribution  (see  Refs.  2-16). 

2 .  Mi ssi on 

The  mission  of  DTIC  is  to  collect,  process,  announce,  re¬ 
trieve,  and  provide  formally  recorded  technical  information  in 
all  of  the  scientific  disciplines  and  engineering  fields  of  in¬ 
terest  to  the  DoD,  its  contractors,  and  other  government  agencies 
and  institutions.  Objectives  have  been  established  by  OUSDRE, 
the  Military  Departments,  and  Headquarters,  Defense  Logistics 
Agency.  General  guidance  in  how  to  attain  these  objectives  is 
provided  by  these  same  organizations,  but  they  rely  on  DTIC  to 
develop  and  implement  its  mission  objectives.  DTIC  is  also 
charged  with  developing  new  products,  services  and  system  im¬ 
provements  for  DoD  technical  information  transfer. 

DTIC  was  established  to  provide  a  single  repository  and 
access  point  for  research  data  from  all  DoD  laboratories  and 
contractors.  Within  the  limits  of  its  mission  statement,  it  also 
assists  in  establishing  new  technical  information  systems  and 
data  bases. 
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3 .  Authority  and  Responsibilities 


DTIC  is  a  component  of  the  Defense  Logistics  Agency  and  the 
Deputy  Under  Secretary  of  Defense  for  Research  and  Engineering 
(OUSDRE)  exercises  overall  policy  direction  for  the  responsi¬ 
bilities  assigned  to  the  Director,  Defense  Logistics  Agency. 
Regulations  state  that  the  Director  of  Technical  Information, 
DRE,  serves  as  the  focal  point  for  carrying  out  this  policy 
direction.  However,  since  there  is  no  such  Director  at  present, 
this  responsibility  is  assigned  to  the  Director,  Research  and 
Information  Management,  ODUSDRE  (R&AT) . 

4.  IDA  Task  for  DTIC 

Under  Task  Order  DTIC-1,  December  10,  1979,  IDA  has  under¬ 
taken  to  study  how  to  improve  access  to  DoD  Scientific  and  Tech¬ 
nical  Information  through  the  on-line  DTIC  data  bases.  DTIC 
operates  a  DoD-wide  on-line  system  to  provide  remote  interaction 
with  four  major  RDT&E  data  bases,  which  are  described  later  in 
this  paper.  This  system  was  originally  designed  in  the  late 
1960s  to  provide  secure  access  to  a  file  containing  classified 
descriptions  of  ongoing  research  efforts.  Although  other  data 
base  applications  have  been  added,  the  DTIC  system  is  designed 
for,  and  constrained  by,  the  need  to  protect  its  classified 
records — which  are  a  small  proportion  (about  10  percent  of  all 
its  records).  Because  of  this  constraint  and  other  design  deci¬ 
sions,  the  DTIC  system  is  presently  incompatible  with  other  DoD 
systems  for  electronic  access  to  or  transfer  of  S&T  information. 
DTIC  cannot,  for  example,  interface  with  and  utilize  the  many 
computer  resource  sharing  capabilities  of  the  DoD-developed 
ARPANET.  It  cannot  benefit  from  many  of  the  software  and  hard¬ 
ware  developments  of  the  ADP  marketplace.  This  deficiency  is 
manifested  by  high  costs  for  operations,  access  and  enhancement 
of  the  DTIC  system.  However,  measures  taken  recently  to  pro¬ 
vide  asynchronous  dial-up  access  to  the  on-line  data  bases  may 
change  this  problem  in  the  near  future. 
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DTIC  is  committed  to  support  and  expedite  information  trans¬ 
fer  among  DoD  agencies,  their  contractors  and  the  national  R&D 
community  and  to  facilitate  access  by  the  DoD  contractor  commu¬ 
nity  to  a  broad  spectrum  of  Scientific  and  Technical  Information 
(STI)  relevant  to  RDT&E  programs.  For  on-line  systems  this  im¬ 
plies  broad,  flexible,  inexpensive  and  uncomplicated  access  and 
compatibility  with  existing  value-added  networks  (e.g.,  ARPANET, 
TYMNET,  TELENET),  the  most  common  types  of  terminal  devices  and 
other  major  retrieval  systems.  DTIC  also  has  the  requirement 
to  provide  full  protection  and  control  for  all  classified  data 
that  is  provided  or  accessible  on-line;  therefore,  a  critical 
element  of  its  design  is  data  security  and  prevention  of  un¬ 
authorized  access  to  the  system.  This  requires  a  high  degree 
of  control,  rigidity,  expense  and  complexity  and  has  led  to  in¬ 
compatible  and  dedicated  access  methods  and  terminals. 

OUSDRE  (R&AT)  has  designated  a  new  and  broader  DTIC  mission, 
oriented  to  expanded,  more  direct  information  and  data  base  sup¬ 
port  to  OSD-level  managers.  The  desired  degree  of  flexibility 
and  responsiveness  conflicts  with  DTIC’s  present  secure  systems 
arrangements . 

B.  DTIC  SERVICES  AND  CAPABILITIES 

DDC  was  directed  by  OUSDRE  to  develop  and  provide  on-line 
terminal  remote  services  to  its  users.  Specifically,  this  effort 
was  designed  (1)  to  support  and  aid  managers,  scientists,  and 
engineers  in  decisionmaking  processes  and  problem  definitions, 

(2)  reduce  information  delays  and  associated  costs,  (3)  increase 
user  "creativity"  through  direct  access  and  interface  with  the 
R&D  data  bases,  and  (4)  eliminate  the  "middleman"  and  thereby 
improve  the  bibliographic  quality. 

Beginning  in  1968,  a  prototype  DDC  Retrieval  System  was  de¬ 
veloped  in-house  to  determine  the  feasibility  of  direct  on-line 
access  to  DDC  data  banks.  Initially,  only  DoD  activities  and 
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other  government  agencies  were  allowed  to  participate.  The  sys¬ 
tem,  as  it  was  developed,  had  an  in-house-programmed  real-time 
communications  handler  that  handled  the  message  transmission  to 
and  from  the  remote  terminals  and  a  batch  applications  software 
package  for  actually  performing  all  the  search/retrieval  system 
capabilities . 

In  1973,  a  prototype  generalized  input  system  was  developed 
in-house  to  provide  a  method  to  input  data  remotely  to  DDC . 

Since  many  of  the  organizations  who  subscribed  to  the  retrieval 
system  also  contribute  input,  it  was  to  the  advantage  of  these 
organizations  to  have  a  remote  input  capability  to  achieve  better 
and  further  utilization  of  their  terminals.  This  is  especially 
advantageous  in  the  case  of  those  remote  sites  that  have  Tele¬ 
communications  Security  (TSEC)  equipment  and  must  input  classi¬ 
fied  data.  The  input  system  was  initially  developed  as  an  alter¬ 
native  to  the  retrieval  system. 

During  the  time  DDC  was  developing  and  enhancing  the  then- 
current  on-line  retrieval  and  input  systems,  on-line  planning, 
system  requirement  analysis,  and  network  expansion  began.  Attain¬ 
ment  of  the  following  objectives  broadened  the  base  of  the  system 
and  moved  away  from  the  strict  "initial"  design  parameters  to 
those  dealing  with  practical  on-line  information  retrieval.  The 
objective  of  this  planning  was  to: 

(1)  Expand  the  system  network  to  include  several  major 
laboratories , 

(2)  Redesign  and  rewrite  the  system  to  improve  operating 
efficiency  and  effectiveness  and  to  accommodate  input 
as  well  as  retrieval  processing  in  one  system, 

(3)  Design,  develop  and  implement  an  unclassified/classified 
data  transfer  network,  and 

(4)  Experiment  with  remote  hardware  devices,  data  manage¬ 
ment  systems  and  computer-to-computer  hook-ups. 
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In  September  197^ 5  DDC  implemented  its  reentrant  Defense 
RDT&E  On-Line  System  (DROLS).  This  system  was  written  com¬ 
pletely  in-house  by  systems  and  programming  personnel  and 
incorporates  use  of  sophisticated  reentrant  coding  and  multi¬ 
ple  program  activities.  The  system  was  developed  to  provide 
the  capability  to  expand  to  more  than  100  terminals.  (The 
previous  system  was  designed  with  a  real-time  communications 
handler  and  each  terminal  was  a  separate  program  competing 
for  time  in  a  time-sharing  environment.  Much  of  the  process¬ 
ing  capability  of  the  computer  system  was  tied  up  with  system 
overhead  of  moving  each  terminal's  program  in  and  out  of  core 
as  various  applications  were  processed.) 

The  new  reentrant  system  is  essentially  a  miniature 
operating  system  which  is  made  up  of  a  Communications  Monitor, 
an  Applications  Controller,  the  Applications  functions  and 
activity  buffers  for  actual  data  manipulation.  The  system 
provides  the  ability  to  sort,  retrieve,  qualify,  display, 
input,  and  interface  with  the  daily  processing  system.  Also 
included  in  the  design  of  the  system  are  specific  security  con¬ 
trols  required  to  make  available,  on-line,  the  four  major 
Defense  data  banks  simultaneously.  It  was  a  major  problem  to 
control  the  simultaneous  access  of  data  by  both  classified  and 
unclassified  users  having  various  scientific  fields  of  interest 
and  need-to-know .  This  problem  was  exacerbated  by  distribution 
limitations  and  the  need  to  control  proprietary  information 
while  making  technical  information  available  to  users  in  a  timely 
manner . 

DTIC  is  one  of  the  few  DoD  organizations,  if  not  the  only 
one,  that  has  approval  to  operate  in  both  classified  and  unclas¬ 
sified  modes  during  the  same  period  of  time  on  the  same  computer. 

Following  are  the  broad  ranges  of  capabilities  offered  in 
an  on-line  environment  to  remote  DTIC  users. 


1 .  Search 
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Users  of  the  Defense  RDT&E  On-Line  System  are  offered  the 
capability  of  structuring  their  own  search  queries.  Subject  and 
non-subject  search  terms  (up  to  a  current  maximum  of  525  terms) 
combined  by  Boolean  operators  (i.e.,  AND,  NOT)  may  be  used  to 
structure  a  search  strategy.  Various  file  design  and  programming 
techniques  allow  users  numerous  methods  for  retrieving  data  from 
the  "very  general"  to  the  "very  specific"  during  search  manipu¬ 
lation.  Immediate  restructuring  of  search  strategies  provides 
the  user  with  the  means  to  refine  the  search  many  times,  which 
enables  him  to  get  to  the  data  that  is  wanted  before  any  decision 
is  made  as  to  whether  a  bibliography  is  desired  or  not.  If  the 
user  does  not  have  the  time  to  view  the  product  of  the  search 
query,  a  method  is  available  to  transfer  those  results  for  proc¬ 
essing  in  an  off-line  mode  and  have  a  printed  bibliography  mailed 
to  his  organization  the  next  day.  Over  400  different  bibliography 
or  report  formats  are  available  for  use. 

2 .  Sort 

This  capability  provides  the  user  with  an  on-line  method 
to  sequence  his  data  output  from  the  terminal  by  ascending  or 
descending  data  elements  as  desired.  The  user  may  use  any  com¬ 
bination  of  acceptable  data  element  fields  to  sequence  desired 
output  on  his  terminal  screen. 

3 .  Data  Display 

One  of  the  major  capabilities  offered  by  DTIC ' s  on-line 
system  is  the  direct  access  into  the  four  major  technical  infor¬ 
mation  data  banks.  Scientists  and  engineers  may  view,  at  remote 
locations,  the  current  status  of  most  of  the  planned,  current, 
and  completed  research  and  development  undertaken  by  the  DoD. 

The  system  provides  users  with  four  specialized  display  formats 
for  each  data  base  but  allows  the  terminal  user  to  describe  his 
own  format  if  he  desires.  There  are  many  options  such  as 
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continuous  display,  continuous  display  and  print,  skipping  ac¬ 
cessions  forward  and  back,  and  other  additional  methods  of 
viewing  desired  output . 

4 .  Data  Qualification 

Data  qualification  capability  allows  further  refinement  of 
search  results.  Financial  data,  dates,  and  other  similar  data 
elements  may  be  searched  on  a  linear  basis  and  each  resume 
scanned  individually  against  user-imposed  qualifications  cri¬ 
teria.  Qualifications  statements  allow  use  of  Boolean  operators 
(i.e.,  AND,  NOT)  and  arithmetic  comparators  (i.e.,  LT,  EQ,  NE, 
GT)  for  defining  qualifications  parameters.  Qualification  re¬ 
sults  may  be  displayed  using  the  display  capability  and  all  of 
its  options. 

5 .  Order  Products 

If  the  user  determines  that  he  does  not  have  the  time  to 
view  the  retrieved  data  at  the  terminal  and  wants  to  have  infor¬ 
mation  mailed  to  him,  DTIC  has  incorporated  into  the  system  a 
means  to  order  either  bibliographies  or  documents  through  use  of 
this  system  option. 

6 .  Input 

A  Remote  Terminal  Input  Subsystem  (RTIS)  has  been  incorpo¬ 
rated  as  a  function  of  the  Defense  RDT&E  On-Line  System  to  pro¬ 
vide  the  capability  of  remote  input  of  data  to  DTIC.  The  input 
subsystem  does  not  allow  the  user  to  directly  change  a  master 
file  of  a  data  base  but  affords  him  the  vehicle  to  interface 
the  remote  terminal  input  with  an  off-line  update  process. 

7 .  Additional  System  Capabilities 

There  are  many  other  system  capabilities  that  allow  for  the 
exhibit  of  various  tutorial  information,  classified  accessions 
displayed  log,  information  log,  data  base  availability  informa¬ 
tion,  and  other  supporting  commands  designed  to  help  the 
operate  the  system  more  effectively. 
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A  Prevalidat ion  Subsystem  was  developed  at  DTIC  to  provide 
in-house  personnel  with  a  means  to  prevalidate,  in  an  on-line 
mode,  requests  made  to  DTIC  for  limited  documents.  In  order  to 
prevalidate  document  requests,  software  was  developed  to  load 
and  query  a  mass  storage  Master  User  Address  Contract  (MUAC) 
Pile  and  the  Technical  Report  Master  Inventory  Pile.  A  deter¬ 
mination  can  be  made  via  this  subsystem  as  to  whether  a  special 
form  is  required  of  a  requester  prior  to  release  of  a  limited 
document . 

9 .  Pup-Check inq  Subsystem 

This  subsystem  was  developed  to  provide  in-house  personnel 
with  a  method  to  help  automate  the  laborious  manual  method  of 
eliminating  duplicates  in  DTIC ’ s  technical  report  collection. 
Various  system  options  are  available  for  the  accomplishment  of 
this  function. 
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C.  SUMMARY 

Outlined  previously  are  the  types  of  computer  systems  and 
subsystems  developed  and  maintained  by  DTIC  in  support  of  its  * 

mission.  Data  systems  applications  in  DTIC  differ  from  those 
in  DLA  Supply  Centers  especially  in  that  DTIC  is  not  principally 
concerned  with  data  processing.  Routine  data  processing  generally 
involves  manipulation  of  numerical  data  in  more  or  less  fixed-  ® 

field  format  with  fairly  well-defined  and  consistent  processing 
procedures.  DTIC ’ s  efforts  are  primarily  directed  to  scientific 
and  technical  information  storage  and  retrieval.  This  involves 
manipulation  of  masses  of  variable  narrative  data,  the  organiza-  ® 

tion  and  processing  of  which  must  lend  itself  to  ready  and  pre¬ 
cise  access  by  the  scientific  and  technical  intellect.  With  the 
On-Line  System  in  particular,  DTIC  cannot  control  how  its  users 
will  approach  the  system,  nor  can  DTIC  anticipate  what  esoteric  ® 

area  of  science  of  technology  each  one  will  be  researching.  The 
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thought  patterns  and  methodology  of  the  user's  scientific  disci¬ 
pline  will  dictate  his  concept  of  how  the  systems  should  serve 
him.  DTIC  must  design  its  systems,  therefore,  to  accommodate 
to  the  vagaries  of  individual  users  as  well  as  to  the  changing 
information  requirements  of  the  research  and  development  commu¬ 
nity  in  general. 

D.  SECURITY 

Of  overriding  concern  during  the  development  and  operation 
of  the  Defense  RDT&E  On-Line  System  was  and  is  the  problem  of 
security  and  the  inadvertent  release  of  limited  or  proprietary 
information.  Classified  and  limited  information  have  to  be  con¬ 
trolled  not  only  by  classification  but  also  on  need-to-know  and 
release  limitations. 

DTIC  currently  has  terminals  located  at  intelligence  agencies 
such  as  NSA,  CIA,  and  DIA;  DoD  military  installations  and  labo¬ 
ratories  such  as  NAVMAT,  NRL,  APWL,  and  RSIC;  Information  Analy¬ 
sis  Centers  such  as  MCIC  and  NTDSC;  military  schools  such  as 
the  U.S.  Naval  Academy  and  the  Defense  Systems  Management 
School  (DSMS);  DoD  contractors;  and  other  federal  agencies. 

The  operating  environment  of  the  system  includes  all  of 
these  terminal  user  types  and  controlled  access  and  release  of 
information  to  each  of  them  by  hardware  or  software  controls 
or  a  combination  of  the  two.  Many  levels  of  security  control 
are  applied  in  all  phases  of  the  operation  of  the  on-line  system 
to  prevent  unauthorized  disclosure  of  data. 

A  set  of  comprehensive  security  control  procedures  was  de¬ 
veloped  by  DTIC  for  operating  the  on-line  system.  Included  in 
the  procedures  is  a  security  test  that  provides  to  remote  ter¬ 
minals  the  opportunity  to  participate  in  periodic  security  integ¬ 
rity  testing  of  the  system.  Test  criteria  are  organized  by 
data  base.  NSA  and  DSA  Security  Officers  have  certified  the 
operation  of  the  system. 
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E.  KEY  DOCUMENTATION 


1  .  DoD  Regulations  and  Directives 

DTIC  is  authorized  to  operate  by  a  series  of  directives 
issued  by  the  Department  of  Defense  and  the  Military  Services. 

For  example,  DoD  Directive  5100.36,  "Department  of  Defense  Tech¬ 
nical  Information,"  December  1962,  provides  for  the  coordination 
and  management  of  the  DoD  Scientific  and  Technical  Information 
Program.  The  policy,  as  explained  in  this  directive,  is  that 
technical  information  programs  will  provide  for  the  interchange 
of  technical  information  within  the  DoD  and  between  the  DoD  and 
the  rest  of  the  technical  world  to  the  maximum  extent  permitted 
by  security.  Moreover,  the  technical  information  program  is  a 
basic  and  integral  part  of  the  RDT&E  function  of  the  DoD.  Also, 
all  DoD  components  involved  in  RDT&E  are  instructed  to  maintain 
contacts  with  all  DoD  information  services  so  that  complete  coor¬ 
dination  of  information  is  achieved.  DTIC  is  instructed  by  DoD 
Instruction  No.  5100.38  "Defense  Documentation  Center  for  Scien¬ 
tific  and  Technical  Information  (DDC ) , "  March  29,  1965,  to  attain 
the  following  objectives: 

"A.  Active  and  continuing  acquisition  of  all 

technical  reports  (except  those  in  certain 
specified  security  categories)  .  .  . 

B.  Prompt  and  well-indexed  announcements  of 
newly  acquired  technical  reports; 

C.  Timely  response  to  requests  for  technical 
reports  and  other  documentation  services; 

D.  Reconciliation  of  information  acquisition, 
storage,  reproduction  and  distribution  methods 
with  DoD  security  policies,  standards,  cri¬ 
teria  and  procedures; 

E.  Rapid  notification  of  availability  of  technical 
reports  to  Information  Analysis  Centers; 


P.  Increased  effectiveness  of  information  flow 
with  other  U.S.  Government  agencies  through 
cooperatively  developed  standards  and  improved 
methods  for  report  dissemination; 

G.  High  standards  for  the  processing  and  distrib¬ 
ution  of  technical  reports; 

H.  Progressive  improvements  in  documentation  process¬ 
ing  and  services  through  continuing  analysis  of 
advanced  techniques  and  equipment; 

I.  Coordination  of  techniques  with  both  domestic  and 
foreign  documentation  and  information  analysis 
centers . " 

DoD  Instruction  5129-^3,  entitled  "Assignment  of  Functions 
for  the  Defense  Scientific  and  Technical  Information  Program," 
January  23,  1963,  assigns  to  the  Secretaries  of  the  military 
departments  and  the  heads  of  other  DoD  components  the  respon¬ 
sibility  to  ensure  that  DoD  Information  Centers  and  DTIC  are 
provided  with  all  pertinent  material  that  results  from  RDT&E 
Programs,  and  it  outlines  responsibility  for  participation. 

DoD  Instruction  No.  7720.13,  April  16,  1968,  provides  de¬ 
tails  on  the  procedure  for  submitting  Work  Unit  Information  Sys¬ 
tem  (WUIS)  reports,  which  are  summaries  of  the  ongoing  research 
and  technology  efforts  being  accomplished  by  DoD  components 
within  the  RDT&E  program.  It  also  assigns  responsibility  for 
the  reporting  and  for  the  operation  of  an  automated  research 
and  technology  WUIS  to  manipulate  such  RDT&E  data  and  informa¬ 
tion.  The  purpose  of  the  program  as  given  in  this  instruction 
is  to  increase  the  effectiveness  of  the  R&D  Program  by  making 
available  brief  descriptions  of  ongoing  research  and  technology 
efforts  to  all  DoD  scientists,  engineers  and  managers. 

The  information  in  the  WUIS  is  developed  at  the  working 
level  and  is  stored  in  a  form  that  will  meet  the  needs  of  various 
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users  by  taking  advantage  of  processing  capabilities  of  modern 
computer  technology.  This  would  assist  R&D  managers  in  identi¬ 
fying  research  and  technology  work  by  scientific  discipline  or 
technology  area,  thereby  permitting  coordination  with  other  DoD 
programs  to  eliminate  undesirable  overlap  or  effort  and  to  help 
determine  whether  R&D  policy  guidance  is  reflected  adequately 
in  specific  areas  of  endeavor.  The  system  will  also  help  the 
individual  scientist  or  engineer  at  the  bench  level  to  observe 
the  current  status  of  technical  efforts  related  to  his  own  work, 
to  identify  individuals  and  organizations  working  in  the  same 
areas  of  interest  so  they  can  be  contacted  for  further  informa¬ 
tion  and  to  maintain  awareness  of  current  status  through  periodic 
review  of  progress  statements  in  pertinent  work  units.  This  in¬ 
struction  further  provides  that  a  DoD-wide  data  bank  containing 
all  work  unit  data  will  be  established  and  maintained  for  OUSDRE 
by  the  Defense  Documentation  Center  (now  DTIC)  of  the  Defense 
Logistics  Agency.  Data  on  work  units  that  must  be  withheld  from 
DTIC  will  be  forwarded  directly  to  the  National  Security  Agency 
(NSA).  This  includes  work  units  that  are  TOP  SECRET,  or  those 
that  deal  with  RDT&E  in  electronic  intelligence,  communications 
intelligence  and  communications  security.  The  instruction  re¬ 
quires  that  data  on  a  work  unit  shall  be  submitted  to  DTIC  or 
NSA  within  fifteen  days  after  the  local  action  which  it  reflects 
has  occurred.  Moreover,  data  shall  be  submitted  at  any  time 
that  significant  progress  or  a  noteworthy  change  has  occurred  in 
the  approach,  resources  estimates  or  any  other  data  element. 

Each  work  unit  is  to  be  reviewed,  updated  and  resubmitted  at 
least  every  year  so  that  the  data  on  file  will  be  up-to-date. 

DoD  Instruction  No.  5100.66,  January  7,  1975,  on  "Establish¬ 
ment  of  Policy  for,  and  Administration  of  Independent  Research 
and  Development  Programs  (IR&D),"  sets  up  a  requirement  and  pro¬ 
cedures  for  the  administration  of  contractor  IR&D  programs.  To 
assist  in  coordinating  contract  and  in-house  R&D  programs  with 
IR&D,  a  computer-based  IR&D  data  bank  is  established  at  DTIC 
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which  contains  information  on  each  IR&D  project.  Only  govern¬ 
ment  personnel  are  given  access  to  the  IR&D  data  bank  since  much 
of  the  data  is  company-proprietary.  All  DoD  R&D  personnel  in¬ 
volved  in  planning  and  initiating  IR&D  projects  are  encouraged 
to  query  the  IR&D  data  bank  to  be  aware  of  related  efforts  al¬ 
ready  underway.  The  IR&D  data  bank  is  a  centralized  body  of 
information  useful  in  identifying  what  IR&D  is  being  pursued  by 
whom  and  for  identifying  contacts  in  the  performing  organization 
for  obtaining  additional  information.  The  data  bank  is  not  a 
real-time  reporting  system;  it  generally  contains  data  only  on 
those  projects  on  which  work  has  started.  The  content  and  for¬ 
mat  of  the  IR&D  Data  Bank  are  established  by  the  IR&D  Technical 
Evaluation  Group,  which  represents  the  Office  of  the  Deputy 
Under  Secretary  of  Defense  for  Research  and  Engineering  (Research 
and  Advanced  Technology)  and  each  of  the  three  Military  Depart¬ 
ments.  The  Defense  Logistics  Agency  is  charged  with  establish¬ 
ing,  maintaining  and  operating  the  IR&D  Data  Bank. 

Directive  No.  5010.22,  November  22,  1976,  "The  Management 
and  Conduct  of  Studies  and  Analyses,"  expands  on  the  earlier 
cited  instructions  with  respect  to  input  of  related  information 
to  the  WUIS  data  base. 

2 .  Military  Services  Regulations  and  Directives 

A  number  of  the  military  services  regulations  implement  the 
instructions  of  the  above  DoD  Directives.  Among  them  are  Army 
Regulations  AR  70-9  and  AR  70-11.  AR  70-9,  August  22,  1973,  up¬ 
dated  October  15,  1973,  "Army  Research  and  Development  Informa¬ 
tion  System  Planning  and  Ongoing  Work  Reporting,"  provides  spe¬ 
cific  instructions  for  preparing  and  submitting  to  the  Army 
Materiel  Command  R&D  Planning  Summary  Data  for  R&D  program  plan¬ 
ning  review  at  the  project  and  task  area  levels.  It  also  pro¬ 
vides  instructions  for  preparation  and  submission  of  Research 
and  Technology  Work  Unit  Summary  Data  for  ongoing  R&D  work  at 
the  unit  level.  In  addition  to  various  Army  receivers  of  this 
information,  the  regulation  requires  that  both  OUSDRE  and  DTIC 
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be  furnished  copies  of  Army  R&D  reports.  DTIC  is  to  be  furnished 
a  complete  copy  of  DD  Form  1634,  R&D  Program  Planning  data  file, 
in  magnetic  tape  format.  Work  Unit  Information  Summaries  are 
filed  on  a  different  form  (DD  1498)  with  the  same  intention. 

AR  70-11,  July  15,  1968,  "Defense  Documentation  Center  for  Scien¬ 
tific  and  Technical  Information  (DDC),"  provides  an  Army  view  of 
DTIC  and  its  functions.  This  regulation  quotes  the  objectives 
of  DDC  given  in  DoD  Instruction  No.  5100.38  (see  above)  and  goes 
on  to  inform  Army  components  how  they  must  cooperate  with  and 
use  DTIC.  In  paragraph  4  it  states,  "The  Objectives  of  the  De¬ 
partment  of  the  Army  components  will  be  to  cooperate  with  DDC  to 
the  maximum  extent  possible.  The  objective  of  DDC  is  to  provide 
timely,  effective  and  efficient  bibliographic  processing,  an¬ 
nouncements  and  secondary  distribution  of  technical  reports  and 
documents  up  to  the  limits  of  its  capacity  and  within  the  limits 
permitted  by  security  and  other  recognized  controlling  statements. 

The  Navy  and  the  Air  Force  also  have  issued  similar  direc¬ 
tives  with  the  purpose  of  providing  RDT&E  information  to  DTIC 
in  standardized  form  (e.g..  Refs.  18,  19,  and  20). 

3 .  Security  Requirements 

In  addition  to  the  directives  that  spell  out  what  DTIC  is 
supposed  to  do,  there  are  the  security  requirements  directives 
that  establish  the  DoD  requirements  and  policy  for  protecting 
classified  information.  Most  explicit  among  these  and  applicable 
to  DTIC ' s  role  is  DoD  Directive  No.  5200.28,  "Security  Require¬ 
ments  for  Automatic  Data  Processing  (ADP)  Systems."  This  direc¬ 
tive  orders  that  the  protection  of  classified  material  in  an  ADP 
system  shall  be  in  accordance  with  that  required  in  DoD  Directive 
5200.1,  "DoD  Information  Security  Program,"  and  DoD  Regulation 
5200. 1R,  "Information  Security  Program  Regulation."  It  states 
that:  "Classified  material  contained  in  an  ADP  system  shall  be 

safeguarded  by  the  continuous  employment  of  protective  features 
in  the  system's  hardware  and  software  design  and  configuration 


# 


and  by  other  appropriate  administrative,  physical,  personnel, 
and  communications  security  controls." 

The  directive  deals  further  with  the  problems  of  multi-level 
security  and  need-to-know .  Controls  are  ordered  for  the  operat¬ 
ing  system  that  can  identify  and  separate  users  and  classified 
materials  on  the  basis  of  need-to-know.  The  security  measures 
to  accomplish  this  are  to  be  contained  within  the  ADP  system's 
operating  system  and  associated  software.  Moreover,  such  con¬ 
trols  shall  conform  to  those  required  for  the  highest  classifi¬ 
cation  and  most  restricted  types  of  material  being  handled  by 
the  system. 

The  directive  further  requires  a  system  operating  in  a 
"true"  multi-level  security  mode,  where  there  may  be  some  users 
with  access  to  the  system  who  have  neither  a  security  clearance 
nor  a  need  to  know  for  the  classified  material  then  contained  in 
the  system. 

The  Directive  further  states  (Dec.  18,  1972)  that  the  goal 
of  a  true  multi-level  security  mode  is  desired  but  considered  to 
be  unattainable  with  the  desired  confidence  due  to  limitations 
in  the  available  hardware  and  software.  The  Directive  authorizes 
the  concurrent  processing  and  storage  of  more  than  one  security 
classification  category  of  material,  together  with  unclassified 
material,  provided  the  following  minimum  conditions  are  met: 

"1.  The  Designated  Approving  Authority  (subsection 
V.C.)  has  determined  that  the  design  and 
operation  of  the  ADP  system  will,  with  rea¬ 
sonable  dependability,  provide  the  consistent 
and  correct  identification  and  segregation  of 
(a)  the  different  security  classification  cate¬ 
gories;  (b)  certain  additional  restrictive 
types  of  classified  material,  where  such  con¬ 
current  processing  is  not  limited  or  prohibited 


21 


by  appropriate  directives  and  (c)  unclassified 
material; 

2.  Measures  have  been  implemented  to  monitor  the 
system  for  malfunctions  and  occurrences  which 
may  adversely  affect  the  dependability  of  such 
identification  and  segregation; 

3.  Procedures  have  been  instituted  which,  in  the 
event  of  a  system  crash,  malfunction  or  other 
occurrence  adversely  affecting  the  dependability 
of  such  identification  and  segregation,  provide 
that  all  system  output  will  be  initially 
marked  and  handled  as  the  highest  classifica¬ 
tion  and  most  restrictive  type  of  material  then 
in  the  system,  pending  a  determination  of  actual 
classification  [pursuant  to  Chapter  II,  DoD 
Regulation  5200. 1-R,  reference  (f)]  —  these 
procedures  shall  remain  in  effect  until  the 
occurrence  cause  is  determined  and  corrected; 
and 

4.  All  ADP  system  users  have  been  advised  that 
this  option  has  been  implemented,  and  they 
are  instructed  to  return  to  the  ADP  System 
Security  Officer  (paragraph  V.C.3)  any  system 
output  that  is  incorrectly  labeled  as  to  classi¬ 
fication  or  that  was  not  requested  by  that 

user . " 

Temporary  exceptions  may  be  authorized  by  appropriate 
authority  for  specific  security  measures  that  might  impair  opera¬ 
tion  and  mission  effectiveness,  although  progress  is  to  be  made 
toward  ultimate  full  compliance  with  the  Directive  at  the  earli¬ 
est  practicable  time.  With  regard  to  peripheral  devices  or  re¬ 
mote  terminals  not  under  the  control  of  a  component  responsible 
for  the  overall  operation  and  control  of  the  ADP  system,  the 
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security  measures  for  the  device  or  terminal  shall  be  prescribed 
by  the  authority  responsible  for  the  security  of  the  overall  ADP 
System  and  such  measures  shall  be  implemented  before  the  user's 
device  may  be  connected.  Connection  to  a  larger  teleprocessing 
network  such  as  WWMCCS  requires  the  approval  and  concurrence  of 
both  the  DoD  component  operating  the  ADP  system  and  the  DoD  com¬ 
ponent  having  overall  responsibility  for  the  security  of  the 
network. 

Transmission  and  communications  lines  and  links  that  provide 
secure  communications  between  components  of  or  to  an  ADP  system 
shall  be  secured  in  accordance  with  DoD  Directive  C-5200.5  and 
DoD  Regulation  5200. 1R. 

4.  Summary  of  Documentation 

This  seemingly  never  ending  trail  of  regulations  and  instruc¬ 
tions  has  the  overall  purpose  of  providing  DTIC  with  its  authority 
to  acquire,  store,  retrieve,  categorize,  index  and  disseminate 
RDT&E  information  generated  by  all  defense  agencies  and  their 
contractors  while  conforming  to  national  security  requirements. 

It  requires  the  individual  services  and  their  contractors  to 
make  available  to  DTIC  on  a  regular  basis,  and  in  standard  for¬ 
mats,  all  scientific  and  technical  information  that  relates  to 
future,  current  and  past  RDT&E  projects.  The  clear  intention  is 
to  avoid  needless  duplication  and  to  enable  scientists  and  tech¬ 
nologists  working  in  military  technology  and  allied  fields  to 
build  on  what  has  been  done  rather  than  repeating  or  duplicating 
the  work  of  others,  as  there  is  a  tendency  to  do  when  the  flow 
of  information  is  curtailed.  It  also  is  intended  to  enable 
managers  to  monitor  and  control  the  flow  of  technical  informa¬ 
tion  in  the  DoD. 

We  also  note  that  security  requirements  contribute  nothing 
toward  this  end.  Security  only  limits  the  number  of  individuals 
and  organizations  that  can  access  and  receive  classified  informa¬ 
tion,  thereby  (it  is  hoped)  keeping  sensitive  information  from 
the  enemies  of  the  United  States. 
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F.  CURRENT  PROCESSING  CONCEPTS* 


DTIC  currently  uses  two  major  methods  for  performing  its 
mission  of  collecting,  processing,  announcing,  retrieving,  and 
providing  scientific  and  technical  information  (STI)  to  scien¬ 
tists,  engineers,  laboratory  technicians  and  management  person¬ 
nel.  These  are  designated  by  the  terms  "Off-Line  Services"  and 
"On-Line  Telecommunication  Services."  Since  this  IDA  task  deals 
only  with  the  On-Line  Services,  we  shall  describe  those  in  de¬ 
tail  here,  while  recognizing  the  complementarity  between  the  two 
kinds  of  services. 

The  on-line  information  at  DTIC  is  contained  in  four  major 
DoD  data  banks.  The  contents  of  each  data  bank  include  data  up 
to  the  level  of  Secret.  Inputs  from  the  military  services,  and 
DTIC  in-house  services  are  organized  by  data  base  and  updated  and 
and  maintained  on  a  defined  cyclic  basis.  Edit  and  audit  checks 
are  applied  during  the  input  and  update  processes  to  point  out 
conflicts  in  the  security/limitation  control  area  and  in  all 
data  elements.  Data  bank  maintenance  and  the  specific  functions 
performed  during  the  update  process  are  controlled  by  the  proc¬ 
essing  elements  unique  to  that  data  bank. 

1 .  Technical  Report  System 

Technical  Report  document  input  processing  by  information 
specialists  at  DTIC  and  at  selected  remote  terminal  sites  in¬ 
cludes  descriptive  cataloging,  subject  categorization  and  sub¬ 
ject  indexing.  The  objective  of  this  process  is  to  bring  scien¬ 
tific  and  technical  information  under  control  and  simultaneously 
produce  a  computer  record  from  the  input  data  or  processing. 

R&D  managers  and  researchers  use  the  files  to  review  re¬ 
search  results  on  a  specific  scientific  or  technological  concept, 
to  identify  the  research  a  particular  laboratory,  installation 
or  researcher  has  done  or  to  locate  a  particular  report.  This 

£ 

Section  P  abstracted  from  DTIC  Statement  (Ref.  16). 
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data  base  contains  both  bibliographic  data  and  amative  summa¬ 
ries  of  the  reports.  It  is  the  largest  data  base  in  DTIC  with 
1.3  million  records  and  it  is  updated  biweekly. 

Input  data  for  the  Technical  Report  (TR)  System  is  in  the 
form  of  the  technical  document  itself  and  a  summary  containing 
descriptive  elements  and  an  abstract.  The  data  elements  and 
abstracts  are  entered  in  the  system  as  machine-readable  records 
via  UNIVAC  Uniscope  CRT  Terminals  that  are  linked  directly  to 
the  UNIVAC  1100/82  computer. 

Data  records  are  entered  as  new  transactions,  deletions  or 
corrections  under  control  of  a  DTIC-developed  software  package 
called  the  Remote  Terminal  Input  System  (RTIS). 

2 .  Research  and  Development  Program  Planning  Data  Bank 

This  data  bank  contains  planned  R&D  project  and  task  level 
summaries.  It  is  intended  to  provide  technical  backup  for  annual 
reviews  and  to  help  R&D  managers  produce  reports  on  specific  re¬ 
search  areas.  It  provides  both  bibliographic  information  as 
well  as  narrative  summaries  of  work  in  progress.  This  data  bank 
receives  3500  new  records  each  year  and  now  contains  a  total  of 
some  14,000  records.  For  this  data  bank,  data  is  received  on 
magnetic  tape  or  is  prepared  in-house  and  digitized  on  UNISCOPE 
terminals  via  the  Remote  Terminal  Input  System  (RTIS).  In  the 
latter  case,  the  RTIS-f ormatted  input  data  is  moved  from  mass 
storage  and  input  indirectly  to  the  update  process. 

3 .  Work  Unit  Information  System 

The  Work  Unit  Data  Bank  describes  ongoing  DoD  Research  and 
Technology  efforts  at  the  work  unit  level.  It  is  intended  for 
the  use  of  R&D  managers  to  identify  ongoing  R&D  and  to  locate 
and  avoid  undesirable  duplication  of  effort.  This  base  also 
contains  bibliographic  information  and  narrative  summaries  and 
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is  updated  fairly  frequently.  It  contains  about  23,000  active 
records,  receives  10,000  new  records  and  about  100,000  record 
changes  each  year. 

4 .  Independent  Research  and  Development  Data  Bank 

The  Independent  R&D  Data  Bank  contains  contractor’s  IR&D 
efforts  shared  with  DoD.  It  is  used  to  identify  industrial  re¬ 
search  efforts  in  specific  areas  of  technology  and  to  determine 
progress.  The  information  available  includes  bibliographic  data 
as  well  as  narrative  summaries.  In  late  1979  the  data  base  con¬ 
tained  records  on  about  27,000  projects  and  was  receiving  new 
records  at  an  annual  rate  of  7,000.  Since  this  data  base  con¬ 
tains  proprietary  information,  it  cannot  be  accessed  by  any  con¬ 
tractor  . 


G.  RETRIEVAL 
1 .  Output  Media 

Retrieval  of  technical  information  at  DTIC  is  provided 
through  various  output  media. 


a.  Bibliographic  Service  -  For  the  past  ten  or  more  years, 
DTIC  has  been  performing  a  bibliographic  service  for 
its  users  in  response  to  questions  asked  about  research 
and  development  activities.  Each  response  requires  a 
mix  of  man/machine  effort  and  generally  is  accomplished 
in  the  following  manner:  A  question  concerning  an  R&D 
development  effort  is  dispatched  to  an  information 
specialist  for  analysis  and  review.  This  information 
specialist  may  contact  the  requester  to  obtain  more 
specifics.  In  any  event,  the  information  specialist 
produces  a  search  strategy  that  is  used  to  obtain  an 
answer  to  the  requester's  question.  This  search 
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strategy  is  developed  on-line  and  when  deemed  satis¬ 
factory  the  search  results  are  transferred  with  other 
search  results  to  a  series  of  ADP  programs  for  pro¬ 
ducing  off-line  hard  copy  printouts,  i.e.,  biblio¬ 
graphies.  This  entire  process,  exclusive  of  mail  time, 
averages  four  to  six  days. 

b.  Current  Awareness  Service  -  DoD  Information  Analysis 
Centers  and  other  DTIC  subscribers  receive  the  cur¬ 
rent  awareness  service,  which  provides  semi-monthly 
bibliographies  consisting  of  documents  announced  in 
Technical  Accession  Bulletins  (TAB)  in  specific  areas. 
These  bibliographies  are  produced  based  on  user-estab¬ 
lished  subject  interest  profiles. 

c.  Scheduled  Bibliographies  -  DTIC  produces  comprehensive, 
prepackaged  bibliographies  on  subjects  of  high  user 
interest.  This  type  of  bibliography  is  assigned  an  AD 
number  and  is  announced  and  available  on  request  by  the 
user  in.  the  same  manner  as  any  other  document. 

d.  Rapid  Response  Bibliographies  -  This  service  provides 
the  user  with  an  unreviewed  computer  search  generally 
within  24  hours.  The  product  consists  of  accession 
numbers  only  and  is  conveyed  by  telephone.  To  benefit 
from  this  service  the  user  must  have  access  to  a  file 
of  the  TR  documents  or  TAB. 

2 .  Document  Request  Processing 

The  Request  Processing  Subsystem  is  designed  to  accomplish 
the  following:  validate  the  eligibility  of  the  requester  to  re¬ 
ceive  the  given  document;  determine  the  source  (reproduction  or 
stock)  from  which  the  request  will  be  filled  based  on  inventory 
counts;  make  necessary  inventory  adjustments;  generate  shipping 
notices,  labels,  and  receipts  for  classified  documents;  and  pre¬ 
pare  the  necessary  historical  records  for  statistical  accumulation. 
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3 .  Technical  Report  Distribution 


Technical  Reports  are  distributed  to  requesters  as  full- 
size  paper  reproduction  or  as  microforms.  The  goal  is  to  permit 
research  managers  and  researchers  to  obtain  DoD-wide  technical 
reports  from  a  single  source.  This  service  can  also  be  provided 
to  managers  on  a  particular  subject  as  the  reports  are  received 
by  DTIC.  DTIC  distributes  one  million  copies  of  reports  each 
year . 


# 
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III.  SOME  DROLS  STATISTICS 

The  characteristics  of  DROLS  have  changed  over  time.  The 
number  of  terminals  has  been  increasing  over  the  last  few  years 
at  an  average  rate  of  about  twelve  per  year.  There  are  nearly 
3000  DTIC  registered  users,  but  the  number  of  DRCLS  user  sites 
is  only  a  small  proportion  (about  120  or  four  percent)  of  the 
total  possible  population.  We  present  here  some  data  associated 
with  DROLS  users. 

A.  DROLS  USERS,  APRIL  1980 

The  following  table,  Exhibit  III-l,  shows  the  users  of 
DROLS  as  distributed  among  the  various  Services  and  kinds  of 
users.  We  have  selected  kinds  of  users  more  or  less  arbitrarily 
in  four  categories  that  are  intended  to  represent  users  having 
different  interests:  (1)  Schools  and  libraries.  These  are 
users  whose  function  is  essentially  to  teach  or  to  provide 
library  services,  but  not  as  part  of  a  larger  organization. 
Examples  of  these  are  the  Service  Academies  and  specialized 
schools,  and  the  Army  Library  in  the  Pentagon.  (2)  IACs  and 
Laboratories.  These  are  specialized  organizations  in  different 
areas  of  technology.  The  IACs,  for  example,  analyze  information 
in  a  particular  field  such  as  plastics,  or  infrared  technology. 
The  laboratories,  such  as  the  Ballistic  Research  Laboratory  or 
the  Naval  Research  Laboratory,  do  basic  research  and  development 
in  specialized  fields.  (3)  Command.  An  operating  command  is 
responsible  for  the  development  or  operation  of  major  systems. 
Examples  are  the  Naval  Sea  Systems  Command  and  the  Naval  Material 
Command.  (4)  Developer.  A  developer  is  a  contractor  performing 
the  prime  contractor's  role  in  developing  a  major  new  military 
system. 
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EXHIBIT  III-l 
DROLS  USERS,  APRIL  1980 
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B.  INTENSITY  OF  USE 


Exhibit  III-2  shows  some  overall  data  on  how  much  use  is 
made  of  DROLS.  It  shows  that  on  a  monthly  basis,  about  1/4  mil¬ 
lion  responses  are  generated  to  requests.  A  peak  day  will  some¬ 
times  generate  as  many  as  14,000  responses  and  a  peak  hour  perhaps 
2200  responses.  These  figures  are  derived  from  DTIC  data  for 
the  months  of  October,  November  and  December  1979*  DTIC  also 
claims  that  96  percent  of  all  responses  are  delivered  in  less 
than  30  seconds  after  the  request  is  input  to  the  terminal.  This 
of  course  is  true  when  the  system  is  up  and  running,  but  there 
may  be  malfunctions  of  the  computer  or  peripheral  equipment  that 
could  cause  delays  on  the  order  of  hours.  While  such  happenings 
are  reasonably  infrequent,  we  believe  that  they  are  not  repre¬ 
sented  in  the  response  time  data. 
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EXHIBIT  1 1 1 -2 


DROLS  RESPONSE  DATA 


Response  per  month . 250,000 

Peak  Day  Responses . 14,000 

Peak  Hour  Responses .  2,200 


•  C.  CLASSIFIED  AND  UNCLASSIFIED  USE  OF  DROLS 

Exhibits  III-3  and  III-4  show  the  distribution  of  use 
according  to  intensity.  It  will  be  noted  that  28  users  each 
viewed  less  than  100  displays  referencing  classified  reports  in 

®  June  1980  while  only  one  user  viewed  as  many  as  2300.  The  next 

chart.  Exhibit  III-4,  shows  the  distribution  of  interrogations, 
both  classified  and  unclassified,  for  a  six-month  period  starting 
in  October  1979.  Almost  half  of  all  users  placed  only  500  or 
less  interrogations  during  this  period,  while  a  much  smaller 
proportion,  only  about  2  percent,  made  as  many  as  7500  uses. 

Also,  on  the  average,  the  classified  user  used  the  system  almost 
50  percent  more  than  the  unclassified  user. 

• 

Exhibit  III-5  shows  some  additional  statistics  on  the  cur¬ 
rent  DROLS.  The  peak  day  is  shown  to  be  variable  from  month  to 
month;  however,  the  peak  hour  tends  to  be  in  the  late  morning 

•  or  early  afternoon,  which  probably  reflects  the  overlap  of  East 
Coast  and  West  Coast  working  hours.  It  will  be  noted  that 
December  generated  fewer  overall  responses  as  well  as  a  lower 
peak  day.  This  is  probably  due  to  the  leave  taken  by  employees 

•  during  the  holiday  seasons. 

Exhibit  III-6  shows  three  months  of  user  statistics,  indi¬ 
cating  the  number  of  users  who  initiated  particular  volumes  of 
searches.  This  table  indicates  that  the  users  might  be  divided 
into  four  categories  according  to  their  intensity  of  use  of  the 
system.  The  lowest  intensity  of  use,  less  than,  say,  400  searches 
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was  done  by  a  relatively  high  proportion  of  users.  From  400- 
1000  searches  were  done  at  a  medium  number  of  terminals;  rela¬ 
tively  large  numbers  of  searches  (1000-5000)  were  done  at  a  large 
number  of  terminals;  and  finally,  over  5000  searches  per  month 
were  done  by  a  small  number  of  super-users. 

EXHIBIT  1 1 1-3 


EXHIBIT  1 1 1-4 
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EXHIBIT  1 1 1-5 


• 

SOME  RECENT  STATISTICS  ON  THE 

CURRENT 

SYSTEM 

OCTOBER 

NOVEMBER 

DECEMBER 

• 

Active  Days  in  Month 

22 

21 

20 

No.  of  Users  in  Month 

128 

126 

131 

Responses  in  Month 

261  ,71 1 

273,751 

201  ,667 

• 

Peak  Day  of  Month 

17 

20 

11 

Peak  Day  Responses 

14,333 

14,926 

13,494 

Peak  Hour 

14:30 

11  : 30 

14:30 

• 

Peak  Hour  Responses* 

34,143 

31  ,489 

27,137 

Daily  Avg.  Peak  Hour 

Responses 

1  ,551 

1  ,449 

1  ,357 

Peak  Single  Hour 

2,217 

2,172 

2 ,1  93 

• 

Monthly  Responses 

of  Peak  User 

17,454 

14,243 

1 1  ,575 

Peak  Hour 

10:30 

10:30 

11  : 30 

• 

Peak  Hour  Responses 

2,852 

2,086 

2,084 

Peak  Outside  User 

DCSLA** 

DCSLA 

DCSLA 

Uses  in  Month 

11  ,161 

8,068 

6,473 

• 

Peak  Hour  Uses 

1  ,997 

1  ,236 

958 

★ 

Cumulative  Responses 

over  the  month 

for  the 

given  peak  hour 

This  is  the  DTIC  Terminal  in  the  Los  Angeles  area  that  is 
available  to  properly  cleared  users.  A  similar  arrangement 
exists  in  the  Boston  area  and  also  at  DTIC  Headquarters  in 
Alexandria,  VA. 
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EXHIBIT  1 1 1-6 


NUMBERS  OF  USERS  REQUIRING  DIFFERENT 
LEVELS  OF  SERVICE  EACH  MONTH  ( EXCLUDES  "IN-HOUSE  TERMINALS) 


NUMBER  OF  SEARCHES 


NO.  OF  USERS  (TERMINALS) 
OCTOBER  NOVEMBER  DECEMBER 


0-200  11 

201-400  16 

401-600  9 

601-800  2 

801-1000  8 

1001-1500  11 

1500-2500  21 

2500-5000  13 

5000+  _ 5_ 

TOTAL  REMOTE  TERMINALS  96 

(Excludes  DTIC  Terminals) 


11 

14 

7 

8 
7 

12 

15 
18 

2 

94 


15 

16 
6 

10 

6 

17 

18 
1 1 

1 

100 
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APPENDIX  A 


CURRENT  FUNCTIONS  OF  THE  DEFENSE  TECHNICAL 
INFORMATION  CENTER  (DTIC) 


I.  GENERAL 

The  following  discussion  treats  only  those  functions  that 
are  pertinent  to  the  scope  of  the  present  study,  most  specifi¬ 
cally,  the  elements  of  the  Defense  RDT&E  On-Line  System  (DROLS). 

II.  TECHNICAL  REPORT  BIBLIOGRAPHIC  SERVICE 

DTIC  is  responsible  for  the  acquisition,  announcement, 
and  secondary  distribution  of  technical  reports  for  the  Depart¬ 
ment  of  Defense  (DoD).  Technical  reports  document  results 
obtained  from  scientific  and  technical  activities.  The  reports 
for  which  DTIC  is  responsible  include  all  those  prepared  by  a 
DoD  activity,  by  contractors  or  grantees  to  a  DoD  activity,  and 
by  organizations  from  outside  DoD  (whether  domestic  or  foreign) 
when  they  are  pertinent  to  DoD  Research,  Development,  Test  and 
Evaluation  (RDT&E)  efforts,  but  they  do  not  include  Top  Secret, 
cryptographic  and  communications  security,  communications 
and  electronic  intelligence,  registered,  administrative,  or 
foreign  (where  dissemination  is  prohibited  by  the  foreign 
government)  documents. 

Authorized  recipients  of  DTIC  services  are  "registered 
users;"  these  may  be  U.S.  government  agencies,  contractors  and 
grantees  to  the  U.S.  executive  branch,  DoD  potential  contractors, 
and  internationally  sponsored  research  centers;  there  are  about 
2800  registered  users.  The  access  of  registered  users  to  par¬ 
ticular  information  may  be  limited  by  their  security  clearance 
or  distribution  limitations  imposed  by  the  DoD  activity  respon¬ 
sible  for  the  technical  report  (a  DoD  activity  may  submit  a 
technical  report  to  DTIC  and  even  request  that  it  not  be  announ¬ 
ced)  . 


Each  technical  report  submitted  to  DTIC  by  a  DoD  activity 
is  accompanied  by  a  Report  Documentation  Page,  DD  Form  1473 
(see  Exhibit  A-l).  From  the  information  on  the  DD  1473  (and 
sometimes  from  the  report  itself),  DTIC  prepares  an  entry  (= 
announcement;  see  Exhibit  A-2)  and  issues  biweekly  a  Technical 
Abstract  Bulletin  (TAB),  a  compilation  of  all  of  the  entries 
for  the  period;  the  entries  in  the  TAB  are  the  primary  product 
of  DTIC  and  constitute  most  of  the  basis  for  the  Technical 
Report  (TR)  data  base  in  the  Defense  RDT&E  On-Line  System  (DROLS). 
No  classified  or  limited  distribution  (see  next  paragraph) 
information  is  published  in  the  TAB. 

In  addition  to  classification  restrictions,  the  technical 
report  and/or  its  abstract  may  be  limited  in  their  distribution. 
The  government  office  controlling  the  report  specifies  the  limi¬ 
tation;  distribution  by  DTIC  without  the  approval  of  the  control¬ 
ling  government  office  may  be  limited  to  U.S.  government  agencies 
only,  DoD  only,  DoD  and  DoD  contractors  only,  or  no  one.  When 
a  report  is  limited  in  any  way  its  DTIC  accession  number  has  an 
"L"  suffix.  If  an  abstract  is  limited  it  is  not  published*  in 
the  entry  in  the  TAB. 

Biweekly  and  annually  DTIC  issues  TAB  Indexes  which  contain 
indexes  by  corporate  author,  subject,  title,  personal  author, 
contract  number,  report  number,  and  release  authority.  Each 
index  permits  one  to  locate  the  entry  for  a  report  where  it 
appears  in  the  biweekly  TAB. 

In  response  to  requests  by  qualified  organizations,  DTIC 
provides  microfiche  or  paper  copies  of  reports. 

Registered  users  can  advise  DTIC  of  the  subjects  of  inter¬ 
est  to  them  (by  means  of  the  Field/Group  subjects  noted  in 
Exhibit  A-2  and  become  subscribers  tc  two  DTIC  services. 

*Nor  are  abstracts  published  in  entries  for  any  rqport  which 
is  furnished  by  the  North  Atlantic  Treaty  Organization  or 
which  carries  the  limitation  Restricted  Data  or  Formerly  Re¬ 
stricted  Data. 

A-4 


SECURITY  CLASSIFICATION  OF  THIS  PAGE  (TTNfi  Dx<  Ertttred) 


REPORT  DOCUMENTATION  PAGE 

READ  INSTRUCTIONS 

BEFORE  COMPLETING  FORM 

1.  report  NUMBER 

2.  GOVT  ACCESSION  NO. 

3.  RECIPIENT'S  CATALOG  NUMBER 

4.  TITLE  (and  Subtltla) 

5.  TYPE  OF  REPORT  6  PERIOO  COVERED 

6  PERFORMING  ORG.  REPORT  NUMBER 

7.  AU  TWO Rf 

8.  CONTRACT  OR  GRANT  NUM S ER(»J 

9.  PERFORMING  ORGANIZATION  NAME  AND  AOORESS 

10.  PROGRAM  ELEMENT,  PROJECT  TASK 

AREA  &  WORK  UNIT  NUMBERS 

11  CONTROLLING  OFFICE  NAME  ANO  AOORESS 

12.  report  oate 

13  NUMBER  OF  PAGES 

14.  MONITORING  AGENCY  NAME  &  AODRE SS(H  dttiarant  from  Controlling  Ottlca) 

IS.  SECURITY  CLASS,  (o i  thia  raport) 

IS  a.  DECL  ASSI  PICATION/  DOWNGRADING 

SCHEDULE 

16.  DISTRIBUTION  STATEMENT  (at  thia  Raport) 

17.  DISTRIBUTION  STATEMENT  (of  tha  abatract  antarad  In  Block  20,  II  dlttarant  from  Raport) 

18.  SUPPLEMENTARY  NOTES 

19.  KEY  WORDS  (Cofitlnu*  on  raaaraa  aida  It  nacaaaory  and  idantitr  by  block  mmtbar) 

20.  ABSTRACT  rConrlnwe  on  rawaraa  aida  It  nacaaaary  and  Idanttty  hy  block  mm* bar) 

DD  }  jJnM73  1  473  EDITION  OF  I  NOV  «5  IS  OBSOLETE 


SECURITY  CLASSIFICATION  OF  THIS  PAGE  fWi*"  Data  Entarad) 

EXHIBIT  A-l .  REPORT  DOCUMENTATION  PAGE,  DD  FORM  1473 


A-5 


one  ACCESSION  NUMBER 


ORIGINATING  AGENCY 


y: 


An-^-)?<  zsiL  ELL  n/4 


TITLE 


OESCRIPTIVC  NOTE 


PERSONAL  AUTHOR  (SI 


PAGINATION 


CONTRACT'GRANT/ARPA 
ORDER  NUMBER(S) 

MONITORING  AGENCY 
ACRON  YM(S)/SERI£S  NUMBER(S) 


SUPPLEMENTARY  NOTE 


DISTRIBUTION/AVAILABILITY 

STATEMENTS) 


SUBJECT  TERMS 


ABSTRACT/SUMMARY 


SOUTHERN  RESEARCH  INST  BIR¬ 


MINGHAM  ALA 
NOMft  "STl'llCTl  VE, 


MECHANICAL 


AND 


THERMAL  CHARACTERIZATION  OF  MOD 
MOD  33,  MOD  3P,  MOD  3R,  MOD  3D,  MOD 
3Nt  MOD  3M  ANT)  PIERCED  ORTHOGONAL 

CARBON-CARDO N  MATERIALS.  (Uj _ 

Pinal  rent.  Aug  74-JuI  76, 


by  H?.rry  E.  Littleton  and  C.  O.  Penrs.  Apr  77, 
Jil2-  ncpL.no.  SQKI-EAS-77-1 13-?230-T(>-I-P 


Contract  E33615-74-C-5029.  Proj.  7381.  ]j 
AFML  TR-77^49 


si  o? 


Unclassified  report 

Prepared  in  cooperation  with  AVCO  Corp  ,  Con¬ 
tract  F336I5-74-C-0089.  See  also  Rept.  no  AFML* 
TR-74-21 1 . 

Distribution  limited  to  U  S  Gov’t,  agencies  only , 
Test  and  Evaluation ;  Apr  77.  Other  reaucsts  for 
this  document  must  be  referred  to  Director,  Air 
Force  Materials  Lab.,  Attn:  MXE  Wright-Patter- 
son  AFB,  OH  45433. 

_ Descriptors  ‘Carbon  carbon  composites. 


•Carbon  phenolic  materials,  ‘Quality  control. 
Billets,  Nondestructive  testing.  Mechanical 
properties.  Tensile  properties.  Thermal  pro¬ 
perties,  Carbon  fibers,  Grapnitc,  Matrix 
materials,  Phenolic  plastics 

The  abstract  or  summary  of  the  report  will 
appear  in  this  position  when  applicable, 
followed  by  a  classification  indicator  of  (U). 


COSATI 

FIELD/GROUP  OESIGNATION(S) 


TITLE  CLASSIFICATION 


REPORT  DATE 


ORIGINATING  AGENCY 
SERIES  NUMBER(S) 


TASK(S) 


PROJECT  <S) 


EPORT  CLASSIFICATION 


ABSTRACT  CLASSIFICATION 


EXHIBIT  A- 2 .  SAMPLE  TAB  ENTRY 

In  the  one  service  the  subscriber  receives  a  custom  bibliography 
based  on  the  current  cycle  (Current  Awareness  Bibliographies). 

In  the  other  service.  Automatic  Document  Distribution,  the  sub¬ 
scriber  receives  microfiche  copies  of  the  reports.  "Demand" 
bibliographies  are  also  provided  as  a  one-time  search. 

DTIC  provides  reproducible  masters  of  unclassified-unlimi¬ 
ted  reports  to  the  National  Technical  Information  Service  (NTIS) 
which,  in  turn,  makes  an  announcement  of  them  and  sells  them 
to  the  public;  these  constitute  over  half  of  all  the  reports 
listed  in  the  TAB. 

III.  DROLS 

DTIC  maintains  four  computer-stored  data  bases  relating 
to  Technical  Reports  (TR) ,  Work  Units  (WU),  Program  Planning  (PP), 


and  Independent  Research  and  Development  (IR).  Except  for  IR, 
which  is  limited  to  DoD  users,  these  data  bases  are  made  avail¬ 
able  to  about  100  remote  terminals  at  registered  organizations 
throughout  the  United  States.  The  IR  data  base  is  accessible 
only  to  DoD  classified  users  and  is  not  treated  in  any  more 
detail  in  this  paper.  The  WU,  PP,  and  TR  data  bases  are  similar 
in  that  the  record,  the  summary,  is  a  description  of  a  research 
and  development  effort  underway  (WU  and  IR)  or  planned  (PP);  a 
senior  or  larger  document  does  not  exist.  The  TR  data  base 
differs  from  these  three  in  that  the  record,  the  entry,  is  a 
citation  for  a  technical  report . 

The  remote  terminal  user  who  knows  the  AD  number  of  the 
record  can  view  or  print  out  the  entry  or  summary,  but  this 
function  is  no  better  than  the  user  could  perform  using  the 
TAB  for  technical  reports  except  that  classified  and  limited 
portions  of  the  record  not  printed  in  TAB,  which  is  unclassified, 
are  available  on  DROLS.  The  important  capability  of  DROLS  is 
the  speed  of  retrieval  in  a  literature  search  when  the  user 
seeks  records  of  work  performed  in  certain  technical  fields,  in 
certain  time  periods,  by  certain  authors,  etc. 

Users  at  Remote  terminals  may  be  qualified  for  access  to 
classified  (Confidential  or  Secret)  information,  for  particular 
Fields/Groups  (technical  areas),  for  special  access  (e.g.,  cri¬ 
tical  nuclear  weapons  information),  and  for  limited  distribu¬ 
tion.  Safeguards  are  placed  in  the  computer  program  to  observe 
such  restrictions. 

A.  TECHNICAL  REPORT  DATA  BASE 

The  format  of  the  entry  for  a  TR  is  shown  in  Exhibit  A-3; 
essentially  it  consists  of  the  bibliographic  information  pre¬ 
pared  for  input  to  the  TAB  as  described  in  Section  II  of  this 
Appendix,  plus  fields  devoted  to  administrative  processes: 
security,  availability,  and  distribution. 

Several  of  the  fields  are  of  special  interest  to  this  study 
and  warrant  description:  .  7 


EXHIBIT  A-3. 


Field^1  ^ 
Number 


FIELDS  IN  AN  ENTRY  OF  A  TECHNICAL  REPORT 

Inverted^2)  Direct^ 


File  File 

Search  Qualify 

Role  Field 

Field  Title  Code  Code 


1  AD  Number,  assigned  by  DTIC  to 
identify  technical  report 


2 

3 

4 

5 

6 

7 

8 
9 

10 
1 1 
12 

14 

15 

16 

17 

18 
1  9 
20 

21 

22 


Field/Group,  assigned  by  DTIC  to 
identify  subject  material 

Security  Classification  of  Entry 

NT IS  Price 

Source  Name;  Corporate  or  Organ¬ 
ization  Author 

Unclassified  Title  of  Technical  55,56 

Report 

Classified  Title  of  Technical  55,56 

Report 

Security  Classification  of  Title 
of  Technical  Report 

Descriptive  Note  (e.g.,  period 
covered,  final,  interim) 

Personal  Author  Names  11 

Date  of  Technical  Report  24 

Number  of  Pages  in  Technical 
Report 

Source  Series  (number  of  technical  51 


report  assigned  by  source) 

Contract  Number  16 

Project  Number  21 

Task  Number  20 

Acronym  of  Government  Monitor  03 

Moni tor  Seri es  53 

Security  Classification  of  Tech-  58 

nical  Report 

Supplementary  Note  (e.g.,  other 
vol umes ) 

Limitations  (on  distribution) 


1 1 


EXHIBIT  A-3  (Cont'd) 


Field^1 ^ 
Number 


(2) 

Inverted'  ' 
File 
Search 
Rol  e 
Code 


Direct^  ' 
File 
Qualify 
Field 
Code 


23 

Descri ptors 

24 

Security  Classification  of 

Descri ptors 

25 

Identi f i ers 

26 

Security  Classification  of 

I  denti f i ers 

27 

Abstract 

28 

Security  Classification  of 

Abstract 

29 

Initial  Inventory  (of  report 
in  DTI C) 

30 

Index  Annotation  (variations 
of  title) 

31 

Special  Code  (limitations  in 
addition  to  Field  22) 

32 

Reclassification  Code 

33 

Limitation  Availability  Code 

34 

Serial  Number  (e.g.,  final, 
supplement) 

52 

35 

Source  Code  (from  Source  Header 
List,  Ref.  Table  A-3) 

02 

36 

Document  Location  (e.g.,  DTIC, 

NTIS ) 

37 

Classification  Authority 

38 

Declassification  Date 

39 

Downgrading  Date 

40 

Geopolitical  Code  (state  and  con¬ 
gressional  district  of  source) 

30 

41 

Type  Code  (from  Source  Header 

List) 

42 

Information  Analysis  Center 
Accession  Number 

04 

43 

IAC  Document  Type 

44 

MCIC  Subject  Terms^^ 

A-9 

48 

41 


EXHIBIT  A-3  (Cont'd) 


F  i  e  1  d  ^  ^ 
Number 

Field  Title 

Inverted '1  2 3 4  ^ 
File 

Search 

Rol  e 

Code 

Di  rect ' 2  ^ 
File 

Qua! i f y 
Field 
Code 

44 

NDTSC  Subject  Terms^ 

47 

44 

PLASTEC  Subject  Terms^^ 

46 

44 

GAC  Subject  Terms^ 

44 

Notes : 


(1)  Field  Number  is  also  the  searching  "Sort  Field 
Code"  and  "Display  or  Print  Field  Code;"  see 
Section  1 1 1  - B  of  this  Appendix. 

(2)  For  searching;  see  Section  III-B,  this  appendix. 

(3)  For  qualifying;  see  Section  III-C,  this  appendix. 

(4)  The  acronyms  represent  the  names  of  Information 
Analysis  Centers.  Each  IAC  utilizes  different 
subject  terms  for  searching. 
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Field  23,  Descriptors 

Based  on  information  on  the  DD  Form  1473  DTIC  selects  terms 
(or  descriptors)  describing  the  content  of  the  technical  report 
(e.g.,  guided  missiles).  These  descriptors  are  selected  in  con¬ 
junction  with  a  "machine-aided  indexing"  process  from  a  computer 
resident  thesaurus,  the  Natural  Language  Data  Base  (NLDB).  A 
printed  list  of  NLDB  posting  terms  is  the  DTIC  Retrieval  and 
Indexing  Terminology,  known  as  the  DRIT  (Ref.  A-l).  From  1978 
on,  assigned  descriptors  are  unclassified.  Prior  to  1978  some 
descriptors  are  unclassified  and  some  may  be  classified.  If 
classified  descriptors  exist,  the  entire  Field  23  carries  the 
classification  and  it  is  that  of  the  report.  Those  descriptors 
that  convey  the  main  subject  of  the  technical  report  are  pre¬ 
ceded  by  an  asterisk  and  are  referred  to  as  weighted  descrip¬ 
tors.  It  is  the  unclassified  terms  of  this  field  which  appear 
in  the  entry  in  the  TAB  (Ref.  Exhibit  A-2). 

Field  25,  Identifiers 

These  are  additional  terms  for  retrieving  the  content  of 
the  technical  report.  Until  1978,  this  field  was  used  for  un¬ 
reviewed  subject  terms  and  specific  names  (e.g.,  Polaris,  F-l4 
aircraft).  It  was  reserved  for  terms  not  in  DRIT.  From  1978 
on,  any  posting  terms  from  DRIT  that  are  considered  classified 
in  context  appear  in  this  field  as  well  as  any  very  narrow  terms 
that  are  therefore  not  in  the  DRIT,  such  as  a  particular  guided 
missile  type  (e.g.,  Polaris).  If  classified  identifiers  exist, 
the  entire  Field  25  carries  the  classification  and  it  is  that 
of  the  report. 

Field  27,  Abstract 

DTIC  sometimes  changes  the  abstract  from  that  on  the  DD 
Form  1473,  most  often  by  eliminating  administrative  informa¬ 
tion  and  shortening.  If  the  abstract  is  poorly  written,  DTIC 
prepares  a  new  abstract.  If  no  abstract  is  provided,  DTIC  may 
provide  one  drawn  from  the  table  of  contents,  introduction  or 
summary . 


A-ll 


Four  fields  can  be  classified:  7  title,  23  Descriptors 
(pre-1978),  25  Identifiers,  and  27  Abstract.  If  the  descrip¬ 
tor  or  identifier  field  is  classified,  some  of  the  terms  within 
it  may  be  unclassified  and  are  so  marked;  Titles  and  Abstracts 
are  classified  totally  at  one  level. 

Only  the  abstract  can  have  its  distribution  limited. 

Fields  42,  43 ,  and  44  are  used  in  TR  records  submitted  by 
Information  Analysis  Centers  (IAC).  Such  centers,  sponsored  by 
the  government,  provide  expertise  in  their  specific  technical 
fields.  Five  of  the  19  DoD-sponsored  IACs  input  bibliographic 
information  on  reports  in  their  specialties..  Because  they 
maintain  their  own  thesauri  in  greater  detail,  the  subject  terms 
are  peculiar  to  each  IAC.  The  reports  cited  by  the  IACs  are  gen¬ 
erally  not  available  via  DTIC  unless  the  citation  is  to  an  "AD" 
document  normally  accessioned  by  DTIC. 

Originally,  the  portion  of  the  DROLS  TR  data  base  contain¬ 
ing  their  bibliographic  records  was  entered  via  remote  input 
directly  from  these  IACs  and  was  retrievable  only  by  them.  In 
1980,  these  records  were  made  retrievable  *  for  the  other  DROLS 
users . 

Section  IY  of  this  appendix  describes  the  retrieval  tech¬ 
niques  available  to  a  user.  The  last  two  columns  of  Exhibit 
A- 3  list  role  codes  required  for  retrieval;  they  are  included 
for  reference. 

B.  WORKING  UNIT  DATA  BASE 

DoD  members,  contractors,  or  grantees  perform  scientific 
and  technology  efforts;  the  smallest  segment  into  which  such 
efforts  are  normally  divided  is  the  Work  Unit.  Summaries  of 
these  Work  Units  make  up  this  data  base;  they  are  updated  at 
least  once  a  year. 

The  format  for  a  summary  of  a  WU  is  shown  in  Exhibits  A-4 
and  A-5;  the  fields  that  describe  the  work  are:  11,  Title;  12, 
Scientific/Technological  Areas;  22,  Key  words;  23,  Technical 
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Objective;  23,  Approach;  25,  Progress;  37,  Descriptors;  and  28, 
Identifiers.  The  remainder  of  the  information  is  administra¬ 
tive  (budgeting,  dates,  security,  etc.).  Access  to  the  WU  data 
could  be  important  to  research  personnel  because  comprehensive 
hard-copy  files  of  the  Summaries  do  not  generally  exist.  The 
data  base  Summary  is  prepared  by  DTIC  from  DD  Form  1498 
(Exhibit  A-4),  submitted  by  the  agency  responsible  for  the 
research.  DTIC  prepares  Field  37,  Descriptors  and  38,  Identi¬ 
fiers  . 

Seven  fields  are  classifiable,  those  mentioned  above  as 
describing  the  work  other  than  Field  12,  and  the  Summary  itself 
can  be  classified  even  if  all  of  the  seven  classifiable  fields 
are  unclassified. 

There  are  two  statements  with  respect  to  distribution. 

Field  8A1  permits  distribution  of  the  entire  Summary  to  (1) 

DoD,  (2)  government,  or  (3)  anyone.  Field  8B  permits  or  denies 
contractors'  access  (without  specific  approval)  to  Fields  1, 
Accession  Number;  2,  Date  of  Summary;  5,  Security  of  Summary; 

6,  Security  of  Work;  7  (All),  Regrading;  10  (All),  Program 
Element,  Project,  Task  Area,  Work  Unit  Numbers;  11,  Title;  12 
(All),  Scientific/Technological  Areas;  17B,  Contract/Grant  Num¬ 
ber;  19A,B,  Responsible  DoD  Organization  Name  and  Address;  20A,B, 
Performing  Organization  Name  and  Address;  20C,D,  Principal  In¬ 
vestigator;  and  23,  Technical  Objective.  Field  8B  is  considered 
to  supersede  the  limitations  of  Field  8A1,  i.e.,  even  if  Field 
8A1  limited  the  distribution  of  the  entire  Summary  to  the  gov¬ 
ernment,  a  contractor  would  have  access  to  the  fields  designated 
by  Field  8B  if  Field  8B  permitted  it.  DTIC  releases  those 
Summaries  which  are  unclassified  and  not  distribution-limited 
to  the  Smithsonian  Science  Information  Exchange  for  release  to 
any  interested  party.* 

l? - 

Recently  NTIS  has  assumed  responsibility  for  reporting  ongoing 

federally  sponsored  research. 
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EXHIBIT  A-4 . 

RESEARCH  AND  TECHNOLOGY  WORK  UNIT  SUMMARY,  DO  FORM  1498 


RESEARCH  AND  TECHNOLOGY  WORK  UNIT  SUMMARY 

1.  AGENCY  ACCESSION* 

2.  DATE  OF  SUMMARY* 

REPORT  CONTROL  SYMBOL 

3.  OATE  PREV  SUM*RY 

A  KINO  OF  SUMMARY 

S.  SUMMARY  SCTY* 

S.  FORK  SECURITY* 

7.  REGRADING* 

•  «.  DISB'N  INSTR'N 

•  tv  SPECIFIC  OATA  • 
CONTRACTOR  ACCESS 

□  YES  D  NO 

9.  LEVEL  OF  SUM 

A.  WORK  UNIT 

10.  NO.  CODES.*  PROGRAM  ELEMENT 

PROJECT  NUM8ER 

TASK  AREA  NUMBER 

WORK  UNIT  NUMBER 

a.  PRIMARY 

t).  CONTRIBUTING 

C.  CONTRIBUTING 

' ! TL £  pre cada  with  Security  Claaatllcatlan  Coda)* 


2.  SCIENTIFIC  AND  TECHNOLOGICAL  AREAS* 


3.  START  3 AT E 


.  ESTIMATED  COMPLETION  DATE 


S-  FUNDING  AGENCY 


6.  PERFORMANCE  METHOO 


17.  CONTRACT  GRANT 
a-  OATES/EFFECTIVE: 
b.  NUMBER:* 

C.  TYPE 

e.  KINO  OF  AWARO: 


18.  RESOURCES  ESTIMATE  A  PROFESSIONAL  MAN  YRS  tv  FUN  OS  f/n  iftogundil 


EXPIRATION: 


FISCAL 

YEAR 


Acceding - 

CUAAINf 

t».  RESPONSIBLE  OOO  ORGANIZATION 
NAME:* 


RESPONSIBLE  INDIVIDUAL 
NAME: 

TELEPHONE: 


21.  GENERAL  USE 


20.  PERFORMING  ORGANIZATION 

AMI:* 


PRINCIPAL  INVESTIGATOR  rpumtah  SSAN  il  V  S  Acadamtc  [natltutlon) 

NAME’* 

TELEPHONE 

SOCIAL  SECURITY  ACCOUNT  NUMBER 
ASSOCIATE  I N VEST! GATORS 
NAME: 

NAME: 


£i~  XEYWOROS  rpracada  E A CH i  ih^TcwrtTT'ciaTa^^anot^oda^ 


23.  TECHNICAL  OBJECTIVE.*  14.  APPROACH,  2S.  PROGRESS  'rumtati  individual  p mtm^mpha  dantitlad  by  nuotbar  praeada  taxi  of  aach  with  Sacuttty  ClaaatUcalton  Coda.) 


i stlablv  to  contractors  upon  on  Qinator'  approval 


DD  1498 


PREVIOUS  EDITION  OF  THIS  FORM  IS  OBSOLETE. 
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EXHIBIT  A-5.  FIELDS  IN  A  SUMMARY  OF  A  WORK 
UNIT  OR  PROGRAM  PLANNING 

Field** 


Work 

Program 

Unit 

Planning 

Field  Title 

• 

t  1 

B 

Accession  Number 

C 

DTIC-Assi gned  Transaction  Code 

1 

Contri butor-Assi gned  Accession  Number 

t  2 

2 

Date  of  Summary 

9 

3 

3A 

Date  of  Previous  Summary 

4 

3 

Kind  of  Summary 

4 

Level  of  Summary 

t  5 

5 

Security  of  Summary 

• 

t  6 

7 

Security  of  Work 

t  7 

6 

Regradi ng 

t  7  A 

6A 

Classification  Authority 

t  7  B 1 

6B1 

Date  of  Declassification 

• 

t  7B2 

6B2 

Declassification  Event 

t  7C1 

6  C 1 

Downgrading  Date 

t  7C2 

6C2 

Downgrading  Event 

t  7D 

6D 

Multiple  Exempt  Category  Codes 

• 

8  A 1 

Distribution  Limitations 

8A2 

Additional  Security  Restriction 

8B 

Contractor  Access 

t  1  0  A 1 

8  A 1 

Primary  Program  Element  Number 

t  1  0A2 

8A2 

Primary  Project  Number 

t  10A2A 

Army  Primary  Project  (Agency  and  Program) 

t  10A2B 

31(1) 

Army  Primary  Project  (Project  Serial  Number) 

t  1  0A3 

8A3 

Primary  Task  Area  Number 

Note:  *  Classifiable  fields. 

**  The  field  numbers  are  the  Display/Print  Fields 
(where  available)  unless  followed  by  (S)  or  (I) 
in  which  case  they  are  Sort  or  Inverted  File 
•  Fields, respectively. 

t  Contractor  may  be  denied  access  by  Field  8B . 
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EXHIBIT  A-5  (Cont'd) 


Field 

Work  Program 

Unit  Planning  Field  Title 


8A4 


t 

1  0A4 

t 

1  0A5 

t 

1  0A6 

t 

1  OBI 

t 

1  0B2 

t 

1 0B3 

t 

10C1 

t 

1  0C2 

t 

1  0C3 

t 

1  0  D 1 

8B1 

8B2 

8B3 

8B4 

t 

10D2A 

t 

10D2B 

t 

1  0D3 

t 

1  0D4 

*+ 

11 

*9 

t 

1 1A 

t 

1  2A 

16A 

t 

1  2B 

16B 

t 

12C 

1  6C 

13 

11 

14 

1  2 

1  5  A 
1  5B 
15C 
1  6 

1  7A1 


Subelement  Number 
Primary  Work  Unit  Area 
Primary  Monitor  Division  Code  (Army) 
Primary  Installation  Code  (Army) 

First  Contributor  Program  Element  Number 

First  Contributor  Project  Number 

First  Contributor  Task  Number 

Second  Contributor  PE 

Second  Contributor  Project  Number 

Second  Contributor  Task  Number 

Prior  Program  Element  Number 

Former  Project  Number 

Former  Task  Area  Number 

Former  Subelement  Number 

Army  Prior  Project  (Agency  and  Program) 

Army  Prior  Project  (Project  Serial  Number) 

Army  Prior  Task  Number 

Army  Prior  Work  Unit 

Title 

Title  Security 

Scientific/Technological  Area,  Code  I 
Scientific/Technological  Area,  Code  II 
Scientific/Technological  Area,  Code  III 
Start  Date 

Estimated  Completion  Date 
Primary  Funding  Agency 
Other  Funding  Agency 
Other  Funding  Agency 
Performance  Method 
Contract/Grant  Effective  Date 
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EXHIBIT  A- 5  (Cont'd) 


% 


Field 


Work  Program 

Uni  t  Planning  Field  Title 


1  7A2 
t  1  7  B 
1  7  C 
1  7  D 1 
1  7D2 
1  7  E 
17F 

1  3A1 

1 8A ( S ) 

1  8  A 1  ( S ) 

1 8A2 ( S ) 

1 8A3 ( S ) 

1 8A4 ( S ) 

1  3A3 

18B(S)  1 3A4 

1 8  B 1 (S) 

1 8B2 ( S ) 

1 8B3 ( S ) 

1 8B4 ( S ) 

1  3B1 
1  3BA 
1  3B3 
1  3B4 
1  3  C 1 
1  3C3 
1  3C4 
14 

+  1  9 A  1 0A1 

+  19B  1  OBI 


Contract/Grant  Effective  Date  (Range) 

Contract/Grant  Number 

Contract/Grant  Type 

Contract/Grant  Partial  Code 

Contract/Grant  Amount 

Contract/Grant  Kind 

Contract/Grant  Cumulative  Dollars 

Current  Fiscal  Year 

Man-years,  CFY 

Man-years,  CFY - 1 

Man-years,  CFY-2 

Man-years,  CFY-3 

Man-years,  CFY-4 

CFY  Percent  Contract 

Funds,  CFY 

Funds,  CFY- 1 

Funds,  CFY-2 

Funds,  CFY-3 

Funds,  CFY-4 

Budget  Fiscal  Year 

Supersede  Record  Code 

BFY  Percent  Contract 

BFY  Funds,  Dollars 

Budget  Fiscal  Year  +  1 

BFY  +  1  Percent  Contract 

BFY  +  1  Funds,  Dollars 

Parti ci pa ti on 

Responsible  DoD  Organization  Name 
Responsible  DoD  Organization  Address 
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EXHIBIT  A- 5  (Cont'd) 


Work 

Program 

Uni  t 

Planning 

Field  Description 

1  0A2 

Responsible  DoD  Organization  Name  (Level  2) 

• 

1  0B2 

Responsible  DoD  Organization  Address  (Level  2) 

1  9C 

10C1 

Responsible  Individual 

19D 

1  0C3 

Responsible  Individual  Phone  Number 

19E 

Responsible  State  or  Country  Code 

• 

1  9F 

1  0C2 

Responsible  Individual  Title 

1  9S 

K 

DoD  Re sponsible  Organization  Sort  Code 

H 

Responsible  DoD  Organization  Type  Code 

19T 

G 

DoD  Responsible  Individual  Source  Code 

• 

19U 

J 

Responsible  State  and  Congressional  Code 

t  20A 

Performing  Organization  Name 

t  20B 

Performing  Organization  Address 

t  20C 

Principal  Investigator 

• 

+  20D 

Principal  Investigator  Name 

20F 

Associate  Investigator  (First) 

20G 

Associate  Investigator  (Second). 

20H 

Principal  Investigator  Title 

m 

20L 

Performing  State  or  Country  Code 

20N 

Performing  Organization  Type  Code 

20S 

Performing  Organization  Sort  Code 

20T 

Performing  Organization  Source  Code 

9 

20U 

Performing  State  and  Congressional  Code 

21 A 

Studies  and  Analysis  Category 

21  B 

R&T/S&A  Relation 

21  D 

Foreign  Area  Research  Study  Category 

9 

21  E 

Military  /Civilian  Application 

•  22 

Keywords 

*L 

Index  Terms 

'  t  23 

*17 

Technical  Objective 

9 

•  24 

*17 

Approach 
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EXHIBIT  A- 5  (Cont'd 


Work 

Program 

Un  i  t 

Planning 

Field  Description 

*18 

PI  ans 

25 

*19 

Progress 

30 

Navy  Primary  Subelement  Number 

31 

Army  Responsible  Organization  Installation 
Digraph 

31 A 

Army  Responsible  Organization  Installation 
First  Digraph 

31  B 

Army  Responsible  Organization  Installation 
Second  Digraph 

31  C 

Army  Responsible  Organization  Installation 
Third  Digraph 

32A 

Navy  Responsible  Individual  Organ izat ion 
Symbol 

32B 

Navy  Principal  Investigator's  Organization 
Symbol 

37 

Descriptors  (Posting  Terms) 

38 

Identi f i ers 

39 

F 

Processing  Date 

40 

Army  Performing  Organization  Identification 
(Source)  Code 

41 

Army  Performing  Organization  Location  Code 

42 

Army  Performing  Organization  Type  Code 

43 

Cumulative  Partial  Contract/Grant  (Army)  Code 

44 

Army  Foreign  Intelligence  Considered 

45 

Army  Coded  Mission  Objective 

46 

Army  Narrative  Mission  Objective 

1  5 

Mission 

47 

Army  Responsible  Organization  Location 

48 

Army  Responsible  Organization  (Source) 
Identification  Code 

20 

General  Operational  Requirements  Code 

C.  PROGRAM  PLANNING  DATA  BASE 


DoD  members,  contractors  or  grantees  perform  research  and 
development  efforts;  each  effort  may  be  categorized  (from 
smallest  component  up)  by  its  work  unit,  task  area,  project, 
and  program  element  numbers.  Planning  is  normally  performed 
in  DoD  in  the  context  of  the  Five-Year  Defense  Program  (FYDP ) . 
Summaries  of  each  effort  in  the  FYDP  at  the  project  level  for 
Research,  and  at  the  project  and  task  area  level  for  Explora¬ 
tory  Development,  Advanced  Development,  Engineering  Development 
and  Operational  System  Development  make  up  this  data  base;  they 
are  updated  at  least  twice  a  year.  The  efforts  described  most 
often  continue  for  several  years  and,  since  any  effort  in  the 
FYDP  must  be  reported  and  the  FYDP  concerns  future  years,  the 
Summaries  may  concern  the  conclusion  of  past  efforts  or  the 
initiation  of  efforts  planned  for  as  long  as  five  years  in  the 
future . 

The  format  for  a  Summary  of  a  PP  is  shown  in  Exhibit  A-6; 
the  fields  that  describe  the  work  are:  9,  Title;  L,  Index  Terms; 
16,  Scientific/Technological  Areas;  17,  Technical  Objective  and 
Approach;  18,  Plans;  and  19,  Progress.  The  remainder  of  the  in¬ 
formation  is  administrative  (budgeting,  dates,  security,  etc.). 
While  the  PP  is  essentially  a  budgeting  document,  access  to  the 
PP  data  base  could  be  important  to  research  or  developmental  per¬ 
sonnel  because  comprehensive  hard-copy  files  of  the  Summaries  do 
not  generally  exist.  The  data  base  Summary  is  prepared  by  DTIC 
from  DD  Form  163^  (Exhibit  A-6),  submitted  by  DoD  research  and 
development  program  managers.  DTIC  prepares  Field  L,  Index  Terms. 

Five  fields  are  classifiable,  those  mentioned  above  as 
describing  the  work  (other  than  Field  16),  and  the  Summary  it¬ 
self  can  be  classified  even  if  all  of  the  five  classifiable 
fields  are  unclassified.  Access  to  each  summary  is  based  upon 
the  user's  need-to-know  as  indicated  by  the  user's  approved 
Field/Group . 


EXHIBIT  A-6 . 

RESEARCH  AND  DEVELOPMENT  PLANNING  SUMMARY,  DD  FORM  1634 


RESEARCH  AMD  DEVELOPMENT  PLANNING  SUMMARY 

J.  KINO  OF  SUMMARY 


1.  AGENCY  ACCESSION 


2-  DATE  OF  SUMMARY 


REPORT  CONTROL  SYMBOL 


4.  LEVEL  OF  SUMMARY 


S.  SUMMARY  SECURITY 


S.  REGRAOI  NG 

GROUP 


■  *ORK  SECURITY 


M  PROGRAM  ELEMCNT/PROJECT/  task  area  NUMBER 


*  title  (Pracada  with  Security  ClatMidcation  Coda) 


«6.  FORMER  PROGRAM  CLEMENT/ PROJECT/ TASK  AREA  NUMBER 


10.  RESPONSIBLE  OOO  ORGAN) 2 A TION 

NAME 

ADDRESS 


RESR  IN  O 
TELEPHONE  NO. 


11  START  DATE 

12  COMPLETION  oate 

11 

RESOURCES 

ESTIMATE 

**  «ot  «  e 

FUNOS 
'Thousands) 

6. 

•.  OF  Fu  NOS 

ON  CONTRACT ' 

grant  programs 

CURRENT  FY 

BUDGET  FY 

Buooer  *% 

U.  PARTICIPATION 


5  MISSION  OBJECTIVE 


It  SCIENTIFIC/  TECHNICAL  AREA 


T  TMROUGN  It. 


OD  1634 
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III.  RETRIEVAL  FROM  THE  DROLS  TECHNICAL  REPORT  DATA  BASE 


A.  GENERAL 

While  a  terminal  user  may  know  the  AD  number  of  a  techni¬ 
cal  report  and  thus  immediately  call  for  the  display  of  any  of 
the  fields,  the  most  powerful  application  of  DROLS  is  in  seek¬ 
ing  the  complete  record  on  a  report  of  which  little  is  known 
initially,  perhaps  just  an  author's  name,  the  year  of  publica¬ 
tion,  or  the  subject.  In  such  complex  retrieval  the  user  may 
resort  to  the  sequential  application  of  several  techniques: 
searching,  qualifying,  listing,  sorting,  and  displaying.  Clas¬ 
sified  terminals  have  a  cathode  ray  tube  (CRT)  for  rapid  dis¬ 
play;  unclassified  users  may  have  a  CRT  or  teletypewriter  ter¬ 
minals.  Any  information  displayed  on  a  CRT  can  also  be  printed. 

Exhibit  A- 7  is  a  guide  to  the  retrieval  procedures  des¬ 
cribed  below. 


* 


EXHIBIT  A-7  .  DROLS  Retrieval  from  the  Technical 
Report  Data  Base 


A-23 


B.  SEARCHING 

DTIC  has  created  Inverted  Piles  for  certain  fields;  an 
Inverted  File  is  an  index  to  the  AD  numbers  of  a  technical 
report  using  a  lead-in  term  characteristic  of  the  technical 
report.  For  example,  all  technical  report  AD  numbers  would  be 
listed  under  the  lead-in  "cruise  missiles"  if  each  of  the  tech¬ 
nical  reports  treated  cruise  missiles  and  the  term  appeared 
among  the  descriptors  or  identifiers.  When  a  DROLS  remote 
terminal  searches,  the  search  is  performed  through  an  Inverted 
File.  Inverted  Files  exist  for  Field  23  Descriptors,  Field  25 
Identifiers,  and  the  19  fields  listed  in  Exhibit  A-8. 

Hierarchies  have  been  constructed  for  two  of  the  fields: 

23 j  Descriptors,  and  35,  Source  Code.  Knowing  the  established 
hierarchy  in  the  field,  a  user  can  indicate  that  the  hierar¬ 
chical  mode  is  desired  (the  symbol  is  $)  and  the  search  would 
be  performed  on  the  term  indicated  and  all  narrower  (junior) 
terms.  Examples  of  the  hierarchies  are  shown  in  Exhibits  A-9 
and  A-10 .  In  a  subject  search  using  the  hierarchical  option  if 
one  entered  "guided  missile  components,"  DROLS  would  report 
finds  for  any  report  carrying  a  descriptor  "guided  missile  an¬ 
tennas,  batteries,  computer,  etc.,"  as  shown  in  Exhibit  A-9. 
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EXHIBIT  A-8.  TECHNICAL  REPORT  FIELDS 
SEARCHABLE  BY  ROLE  CODE 


Rol  e 
Code 

Field 

Number 

Field  Title 

55,56 

6 

Unclassified  Title  of  Technical  Report 

55,56 

7 

Classified  Title  of  Technical  Report 

1 1 

10 

Personal  Author  Names 

24 

1 1 

Date  of  Technical  Report 

51 

14 

Source  Series  (Number  of  Technical  Report) 

16 

1  5 

Contract  Number 

21 

16 

Project  Number 

20 

17 

Task  Number 

03 

18 

Monitor  Acronym 

53 

19 

Monitor  Series 

58 

20 

Security  Classification  of  Technical  Report 

52 

34 

Serial  Number 

02 

35 

Source  Code 

30 

40 

Geopol i ti cal  Code 

04 

42 

IAC  Accession  Number 

48 

44 

MCIC  Subject  Terms 

47 

44 

NTDSC  Subject  Terms 

46 

44 

PLASTEC  Subject  Terms 

44 

44 

GAC  Subject  Terms 

Note : 

In  searching 

by  Role  Code  there  is  limited  searching 

that  can  be  done.  In  Fields  6,  7,  14,  19,  34,  and  42 
only  a  single  statement  pertaining  to  a  particular  report 
can  be  entered  by  the  user.  In  Fields  10,  11,  15,  16, 

17,  18,  35,  and  40  more  searching  can  be  performed, 
sometimes  by  masking.  Field  44  provides  good  search 
capability  due  to  the  fine  detail  of  the  terms.  By 
using  combinations,  searching  can  be  enhanced. 
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EXHIBIT  A-9.  EXAMPLE  OF  POSTING  TERM  HIERARCHY 


GUIDED  MISSILES 

(1 ) AI R-AI R-MI SS I LES 
(1 ) AI R-TO-SURFACE  MISSILES 
(1 )AIR-TO-UNDERWATER  MISSILES 
( 1 ) ANTIAIRCRAFT  MISSILES 
(1 ) ANTIRADIATION  MISSILES 
(1  )ANTISHIP  MISSILES 
(1  )CRUISE  MISSILES 
( 1 ) FLEET  BALLISTIC  MISSILES 
( 1 ) GUIDED  MISSILE  COMPONENTS 
( 2 ) GU I DED  MISSILE  ANTENNAS 
( 2 ) GU I DED  MISSILE  BATTERIES 
( 2 ) GU I DED  MISSILE  COMPUTERS 
( 2 ) GU I DED  MISSILE  DOMES 
( 2 )GUI DED  MISSILE  FUZES 
( 2 ) GU I DED  MISSILE  WARHEADS 
( 2 ) GU IDED  MISSILE  WINDOWS 
( 2  )  NOSE  CONES 

(1  RECONNAISSANCE  MISSILES 
(1  )SURFACE-TO-AIR  MISSILES 
(1  )SURFACE-TO-SURFACE  MISSILES 
(1 )UNDERWATER-TO -SURFACE  MISSILES 


Source : 


Ref.  A-l 
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EXHIBIT  A- 1 0 •  EXAMPLE  OF  SOURCE  HIERARCHY 


ORGANIZATION 


Aerospace  Corp.,  El  Segundo,  CA 

•Aerospace  Corp.,  El  Segundo,  CA 
Administration  Div. 

•Aerospace  Corp.,  El  Segundo,  CA 
Advanced  Programs  Div. 

•Aerospace  Corp.,  El  Segundo,  CA 
Concepts  and  Plans  Group  Directorate 

•Aerospace  Corp.,  El  Segundo,  CA 
Development  Operations 

••Aerospace  Corp.,  El  Segundo,  CA 
Reentry  Systems  Div. 

••Aerospace  Corp.,  El  Segundo,  CA 
Technology  Operations 

•Aerospace  Corp.,  El  Segundo,  CA 
Development  Planning  Div. 

•Aerospace  Corp.,  El  Segundo,  CA 
El  Segundo  Technical  Operations 

••Aerospace  Corp.,  El  Segundo,  CA 
Applied  Mechanics  Div. 

••Aerospace  Corp.,  El  Segundo,  CA 
Space  Systems  Div. 


SOURCE 

CODE 

009500 

407479 

410271 

409924 

409981 

409055 

403965 

4081 31 

4001 56 

403509 

400752 


Source:  Ref.  A-2 


A  second  special  option  is  "masking".  The  term  stated  by 
the  user  is  considered  to  be  the  beginning  of  any  possible  term 
in  the  field.  For  example,  if  one  were  searching  personal 
authors  (personal  authors'  names  are  listed  in  a  manner  such  as: 
BROWN  RF)  but  did  not  know  the  initials  or  whether  there  was  a 
coauthor,  the  searcher  could  mask  (using  the  symbol  % )  and  insert 
BROWN.  The  search  would  be  performed  for  all  authors  of  surname 
Brown . 

A  search  may  be  performed  on  the  subject  or  the  term  role 
and  may  be  limited  by  the  accession  number  (Field  1,  AD  Number, 
of  Exhibit  A-3).  These  techniques  are  defined  below. 

1.  $u b j ect .  The  user  inserts  terms  denoting  the  subjects  of 
interest,  which  terms  may  be  obtained  from  the  DRIT  or 
from  another  list  provided  by  DTIC ,  the  Frequency  Count 
(containing  all  terms  ever  used  as  descriptors  or  identi¬ 
fiers);  DROLS  will  search  the  Inverted  Files  in  Fields 
23,  Descriptors  and  25,  Identifiers.  If  the  subject  term 
has  been  obtained  from  the  DRIT  and  if  there  are  narrower 
terms  under  it,  the  user  may  invoke  the  hierarchical  mode. 
Masking  is  available  on  any  term  inserted.  In  addition, 
if  the  subject  term  is  from  the  DRIT  it  may  be  entered 

as  a  Weighted  Descriptor  (the  preceding  symbol  is  *)  and 
only  technical  reports  will  be  identified  which  have  that 
Weighted  Descriptor  as  a  main  theme. 

2.  Term  Role.  The  user  may  search  any  field  of  Exhibit  A-8 
by  inserting  the  role  code  (preceded  by  ?).  The  hier¬ 
archical  technique  is  available  on  35,  Source  Code.  In 
searching  Field  6,  Unclassified  Title  or  73  Classified 
Title,  the  user  must  know  the  exact  title.  In  either 
case,  a  key  of  12  characters  is  created  from  the  title 
to  search  an  Inverted  File;  under  Role  Code  55  the  user 
creates  the  key;  under  Role  Code  56  the  system  creates 


the  key  from  the  inputted  title.  Masking  is  available 
on  any  of  the  fields  of  Exhibit  A-8  except  under  Role 
Code  55  and  56. 

3.  Accession  Number.  The  user  may  limit  the  search  to  a 
span,  or  spans,  of  technical  report  accession  numbers 
(Field  1  in  Exhibit  A-3;  the  field  number  is  not  spe¬ 
cified,  i.e.,  this  is  not  a  term  role). 

4.  Combinations.  A  subject  search  is  refined  by  the  Boolean 
operator  AND  to  combine  terms,  e.g.,  to  find  reports  on 
fighter  aircraft  engines  the  search  terms  would  read: 
fighter  aircraft  and  engines.  Fighter  aircraft  is  the 
first  level.  If,  say,  5000  such  records  were  found,  the 
computer  then  searches  those  5000  records  for  engines 
and  finds,  say,  300. 

5.  Response .  The  DROLS  response  to  the  user  is  a  display 
of  statistics,  the  number  of  finds  at  each  level  of 
search.  The  search  levels  are  the  original  user  search 
instructions  in  order  1,  2,  3,  etc.  In  the  example  in 
Paragraph  B. 4  above,  the  first  level  would  be  5000,  the 
second  300,  and  the  third  the  span  of  AD  numbers.  The 
Statistics  indicates  the  number  of  finds  at  the  first 
level,  levels  1  and  2  (thus  a  smaller  number  than  level 
1  above),  levels  1,  2,  and  3  and  levels  1,  2,  3,  and  4. 

C.  TEXT  SEARCHING 

Following  a  Search,  the  user  may  wish  to  examine  6,  Unclas¬ 
sified  Title;  7>  Classified  Title,  and/or  27,  Abstract  for  some 
term;  this  is  called  Text  Searching.  The  system  response  is 
similar  to  that  of  a  Search  in  that  the  number  of  reports  pass¬ 
ing  the  new  criteria  is  reported. 
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D.  QUALIFYING 


Following  a  Search  or  Text  Searching,  the  user  may  wish  to 
either  restrict  the  inquiry  by  specifying  additional  limitations 
not  available  in  the  Search  mode;  this  is  called  Qualification. 
In  Qualification,  DROLS  scans  the  Direct  File  (not  the  Inverted 
File  scanned  in  the  Search  mode),  i.e.,  it  scans  the  particular 
entries . 

For  technical  reports  qualification,  only  one  of  two  fields 
can  be  queried,  from  Exhibit  A-3: 


QUALIFY 

FIELD 

CODE 

NUMBER 

FIELD  TITLE 

11 

11 

Date  of  Technical  Report 

41 

41 

Type  Code  (a  code  letter  or  num¬ 
ber  assigned  by  DTIC  to  each  type 

of  contributing  organization,  e.g., 
academic,  industrial,  particular 
government  agency) 

Operating  on  the.  finds  from  the  Search  the  user  may,  for 
example,  limit  the  dates  of  the  technical  reports  sought  to 
some  span  of  dates  (Qualifying  Code  11).  The  System  response 
is  similar  to  that  of  a  Search  in  that  the  number  of  now  report- 
date-limited  finds  is  reported. 

If  both  Qualifications  are  desired  the  file  may  be  moved 
into  the  User  File  after  the  first  Qualification,  and  the  sec¬ 
ond  Qualification  performed. 

E.  LISTING 

Following  either  a  Search,  Text  Searching  or  a  Qualification 
the  user  may  request  that  the  AD  numbers  be  listed  for  all  finds. 
The  system  response  is  a  listing  of  AD  numbers  in  descending 
sequential  order. 


F.  SORTING 


Following  a  Search,  Text  Searching,  Qualification,  or  List¬ 
ing  the  user  may  request  that  information  on  the  entries  found  b 
arranged  in  a  specific  order  and  displayed  (requires  a  separate 

•  Display  command) .  Up  to  three  of  the  fields  of  Exhibit  A-3  may 
be  relisted  for  sorting.  For  example,  if  Fields  10,  Personal  Au 
thor  Name  and  14,  Source  Series  (Number  of  Technical  Report)  had 
been  identified  for  sorting,  then  there  would  be  displayed  an  au 

•  thor's  name  followed  by  Cin  order)  report  numbers  by  the  author, 
then  alphabetically  the  next  author's  name  and  his  reports,  etc. 


G.  DISPLAYING 


Usually  the  ultimate  goal  of  the  user  is  to  acquire  some 
detailed  information  from  the  entries  of  certain  technical  re¬ 
ports  so  as  to  better  decide  which  reports  are  of  interest. 
Following  Search,  Qualification,  Listing,  or  Sorting  the  user 
can  request  a  Display  of  fields  he  selects  from  the  entries  of 
the  technical  reports  which  interest  him.  Had  the  user  known 
the  AD  number  of  a  technical  report  of  interest  (without  using 
DROLS  to  acquire  the  number)  he  could  also  request  a  similar 
display  for  a  single  technical  report.  To  better  understand  the 
content  of  a  technical  report  the  user  would  probably  request 
for  display  Fields  7,  Title;  23,  Descriptors;  25,  Identifiers; 
and/or  27,  Abstract. 
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APPENDIX  B 

CURRENT  ON-LINE  SYSTEM  HARDWARE  AND  SOFTWARE 


A.  GENERAL 

The  following  description  of  the  DTIC  on-line  facilities 
has  been  provided  by  DTIC.  Much  of  the  text  that  follows  is 
taken  verbatim  from  a  DTIC  publication  (Ref.  B-l)  with  minor 
editorial  changes  made  for  the  purposes  of  this  paper.  DTIC 
is  continuously  changing  and  upgrading  its  system  and  several 
things  were  changed  during  the  course  of  this  project.  Hence, 
this  description  is  likely  to  be  obsolete.  However,  before 
describing  the  equipment  at  DTIC  it  is  important  to  describe 
the  peripheral  environment  since  it  affects  many  requirements 
on  DTIC. 

B.  PERIPHERAL  ENVIRONMENT 

There  exists  an  unclassified  technical  data  base  that  may 
be  accessed  readily  by  anyone  with  a  suitable  terminal,  regard¬ 
less  of  security  clearance.  This  base  is  shared  with  the  Na¬ 
tional  Technical  Information  Service  (NTIS).  Although  DTIC 
provides  unclassified  and  unlimited  services  to  its  users,  copies 
of  all  unclassified  technical  reports  that  have  no  restrictions 
on  their  use,  and  the  related  bibliographic  data,  are  submitted 
by  DTIC  to  NTIS,  which  is  then  responsible  for  their  dissemi¬ 
nation  to  the  general  public.  NTIS  leases  the  bibliographic 
tapes  of  this  information  to  one  or  more  of  the  commercial  data 
bases.  However,  NTIS  is  prohibited  from  having  information  that 
is  classified  or  controlled  in  any  way.  DTIC  is  responsible  for 
storing  and  distributing  such  controlled  information  only  to  those 
users  who  have  established  appropriate  clearances  and  need-to- 

know,  in  advance,  for  the  information  they  are  requesting.  Such 
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clearances  are  established  by  a  designated  clearing  agency  and 
by  the  contracting  agency  according  to  the  fields  of  interest 
of  the  requester. 

It  is  conceivable  that  an  individual  having  acquired  the 
correct  password  and  identification  code  could  gain  access  to  a 
classified  terminal  and  connect  up  the  the  DTIC  computer.  Hence, 
it  is  essential  that  any  terminals  which  are  cleared  for  clas¬ 
sified  information  must  have  physical  .security  controls  plus 
personnel  security  associated  with  the  possible  users.  This 
means  that  the  security  of  the  entire  system  is  dependent  on  the 
maintenance  of  remote  site  security  practices  which  are  outside 
of  the  purview  of  DTIC,  except  that  a  site  is  certified  as  prop¬ 
erly  classified  by  the  contracting  officer  and  security  officers 
responsible  for  the  contractor's  facility.  Once  DTIC  has  such 
certification  in  hand  it  can  then  provide  an  access  code  to  the 
terminal  in  that  facility.  In  addition,  since  communications 
lines  are  not  considered  secure,  all  material  sent  to  a  clas¬ 
sified  terminal  is  encrypted  at  DTIC.  Due  to  the  need  for  de¬ 
crypting,  it  is  necessary  for  the  user  to  have  at  least  one 
individual  cleared  for  this  purpose,  since  the  encrypting  code 
is  changed  frequently.  Now  it  can  be  seen  how  the  security  of 
the  DTIC  system  depends  on  the  security  of  the  peripheral  en¬ 
vironment  . 

Unclassified  user's  terminals  can  also  access  the  DTIC  sys¬ 
tem,  but  cannot  receive  any  classified  data  on-line.  Even  un¬ 
classified  information,  while  it  does  not  have  to  be  encoded, 
may  have  some  restriction  on  it  so  that  it  cannot  be  sent  out 
freely  to  any  requester.  Hence,  the  DTIC  system  must  ensure 
that  it  is  sending  information  out  only  to  appropriate  receivers. 
This  problem  is  handled  in  the  following  way.  The  DTIC  system 
is  set  up  so  that  a  user  at  an  unclassified  terminal  can  access 
only  the  unclassified  data  base.  If  such  a  user  wants  classi¬ 
fied  information,  he  must  get  to  a  classified  terminal  or  request 
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it  by  mail.  The  right  to  receive  such  information  by  mail  is 
checked  by  human  intervention. 

In  support  of  these  off-line  services,  DTIC  has  several 
kinds  of  facilities  on  its  premises  at  Cameron  Station  in 
Alexandria,  VA.  These  facilities  include  a  print  shop  which 
prints  hard  copies  of  reports  on  order.  Also,  there  are  faci¬ 
lities  for  producing  microfiche  copies.  In  addition,  there 
are  cataloguing,  indexing  and  other  general  library  services 
available . 

C.  ON-LINE  SYSTEM 

The  Defense  RDT&E  On-Line  System  provides  the  capability 
for  directly  querying  DTIC ’ s  store  of  TR  data  and  R&D  Management 
data.  Circuits  between  DTIC  and  classified  remote  terminals  are 
secured  through  the  use  of  Telecommunications  Security  (TSEC) 
equipment  to  protect  transmission  of  classified  material.  Var¬ 
ious  peripheral  printers  available  to  each  terminal  site  pro¬ 
vide  a  limited  capability  for  producing  hardcopy  output . 

The  present  hardware  configuration  includes  UNIVAC  Commu¬ 
nications  Terminal  Module  Controllers.  Two  hundred  and  fifty- 
six  communications  access  posts  are  projected.  This  could 
accommodate  a  mix  of  up  to  600  dedicated  and  dial-in  terminals. 

The  On-line  System  software  is  a  complex  set  of  interfaces 
between  data  banks,  terminal  sites,  applications  programs,  etc. 
Appendix  C  provides  a  detailed  description  of  the  On-Line  System. 

D.  COMMUNICATIONS  SUBSYSTEM 

The  Communications  Subsystem  performs  the  function  of 
providing  a  flow  of  data  to  and  from  the  central  processor  and 
the  remote  terminal  devices  of  the  system.  A  brief  description 
of  each  major  element  in  the  Communications  Subsystem  follows: 


1.  The  CTMC  is  a  multiplexor  subsystem  interfaced  to  the 
central  processor  (1100/82)  on  an  External  Specified  Index  (ESI) 
I/O  Channel.  The  CTMC  controls  from  1  to  16  Communications 
Terminal  Modules  (CTM),  each  housing  four  Communications  Line 
Terminals  (CLT). 

2.  The  CLT  is  the  actual  interface  to  a  remote  terminal 
through  MODEMS  and  a  communications  line.  Transmission  lines 
are  placed  within  the  CTMC  of  each  remote  terminal  device.  Be¬ 
cause  of  both  an  input  and  output  requirement  for  each  remote 
terminal,  two  CLTs  are  required  per  remote  terminal,  limiting 
the  maximum  number  of  remote  terminals  to  32  per  CTMC.  The 

CLT  formats  data  and  presents  service  requests  to  the  CTMC  which, 
in  turn,  scans  all  the  CLTs  and  selects  and  locks  into  the  high¬ 
est  priority  CLT  requesting  service. 

3.  The  CLT  connected  to  the  CTMC  has  a  unique  identifi¬ 
cation  number.  This  identification  is  placed  on  the  input 
data  lines  for  either  input  or  output;  if  input,  the  data  ac¬ 
companies  the  identification. 

E.  COMMUNICATION  CIRCUIT 

A  remote  terminal  device  is  connected  to  a  MODEM,  which 
is  connected  to  a  communication  line  or  network  that  terminates 
in  a  second  MODEM  at  the  central  site.  The  central  site  MODEM 
is  connected  to  the  CTMC,  which  routes  the  communication  data  to 
and  from  the  central  processor. 

F.  UNISCOPE  200  and  100 

The  UNISCOPE  200  and  its  predecessor,  the  U100,  visual  com¬ 
munications  terminals  are  two-way  remote  terminal  devices  which 
make  possible  time-shared  direct  data  communications  with  the 
central  processor.  Each  UNISCOPE  terminal  is  keyboard  operated 
and  has  a  Cathode  Ray  Tube  (CRT)  for  message  display,  the  CRT 


displays  the  processor  output  message  and  allows  input  messages 
to  be  composed  and  edited  before  they  are  transmitted  to  the 
processor . 

The  operator  is  required  only  to  compose  the  message  on 
the  display  and  initiate  transmission  to  the  processor.  The 
UNISCOPE  terminal  automatically  decodes  characters  and  func¬ 
tions  in  all  messages  to  the  processor. 

The  exchanges  and  control  of  traffic  within  the  system 
are  controlled  entirely  by  the  processor.  Exchange  of  data 
between  the  processor  and  remote  terminals  is  accomplished  by 
a  system  of  interrogation  and  reply  (polling) .  The  processor 
sends  a  Poll  Message  (request  for  information)  to  a  remote 
terminal  and  the  terminal,  in  turn,  replies  with  either  a 
Query  or  No  Traffic  Message. 

G.  SYSTEM  GENERATION 

At  system  generation  time,  each  channel  is  completely 
defined.  For  communications  devices,  this  includes  specifying 
the  subsystem  type  and  type  of  line  terminal  device  connected 
to  each  remote  line  (bits  per  character,  speed,  fixed  or  com¬ 
mon  carrier,  etc.).  At  that  time,  various  devices  connected 
to  a  single  line  are  given  a  Line  Terminal  (LT)  identity. 

This  identity  is  used  in  assigning  communications  devices. 

H.  DATA  BANKS 

The  data  fields  that  comprise  the  various  data  banks, 
varying  from  fixed  one-character  codes  to  variable,  free-flow 
text  data  fields  are  contained  in  the  data  banks.  File  sizes 
of  the  various  data  banks  vary  from  several  hundred  to  almost 
a  million  unique  records. 

The  data  bank  consists  of  two  distinct  files.  The  Data 
File  (Direct  File)  is  the  Master  File  and  contains  all  the 
information  pertinent  to  each  reportable  work  document  (work 
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unit  record,  technical  report,  etc.).  To  facilitate  retrieval 
of  these  documents,  certain  entries  from  each  document  (search 
terms)  are  extracted,  collected  and  sorted  into  sequence  to 
make  the  Index  Pile  (Inverted  Pile).  Associated  with  each 
search  term  on  the  Index  File  is  the  accession  number  of  each 
document  from  which  it  was  extracted,  thus  producing  a  compre¬ 
hensive  index  for  rapid  search  purposes. 

No  on-line  file  maintenance  exists.  Both  Direct  and 
Inverted  Files  within  each  data  bank  are  updated  on  tape  and 
loaded  to  mass  storage  on  a  scheduled  cyclic  basis.  During 
this  load,  two  sets  of  pointer  tables  (one  for  each  file)  are 
created  to  aid  in  locating  the  data  on  mass  storage  during 
searches . 

I .  Retrieval 

The  on-line  retrieval  system  performs  the  following  major 
functions:  search,  display,  qualification,  format,  sort, 

batch  tutorial,  and  log.  Some  of  these  functions  cannot  be 
performed  against  every  data  bank.  Other  functions  can  be 
performed  against  specific  data  banks  only  to  a  limited  extent. 

J.  MACHINE-AIDED  INDEXING  (MAI)  AND  NATURAL  LANGUAGE  DATA 
BASE  (NLDB ) 

The  technical  reports  received  at  DTIC  subsequently  become 
part  of  the  data  collection  and  are  indexed  for  retrieval.  The 
indexing  is  accomplished  through  the  machine-aided  indexing  sys¬ 
tem. 

The  principal  components  of  the  system  are  two  different 
dictionaries.  The  first  of  these,  the  Recognition  Dictionary, 
consists  of  single  words,  each  of  which  is  tagged  with  one  of 
several  possible  computer  routines.  As  text  is  read  into  the 
computer,  one  word  at  a  time,  each  word  is  looked  up  in  this 
dictionary,  a  designated  routine  is  called,  and  a  word  string 


is  built  up  as  a  possible  index  term.  Whether  or  not  any  given 
string  is  accepted  as  an  index  term  depends  upon  the  second  dic¬ 
tionary,  the  Format  Dictionary..  All  word  strings  are  matched 
against  this  small  dictionary  for  acceptability. 

The  Recognition  Dictionary  understandably  grows  as  more  and 
more  text  is  indexed.  The  Format  Dictionary,  on  the  other  hand, 
has  stabilized  at  a  specific  number  of  permissible  string  types. 
Only  a  few  strings  longer  than  four  words  are  permitted.  The 
most  common  strings  found  are  ZZ,  AZ,  N,  AZZ  and  ZZZ,  where  Z 
represents  a  noun  that  requires  modification  (it  is  not  accepted 
in  isolation),  A  represents  an  adjective,  and  N  is  a  noun  seman¬ 
tically  strong  enough  to  occur  in  isolation  as  a  subject  index 
term. 

The  text  may  be  any  scientific  prose  and  is  not  pre-edited. 
The  text  is  matched  against  the  Recognition  Dictionary  of  single 
words  and  acceptable  words  are  placed  in  temporary  storage, 
where  word  strings  are  accumulated.  These  word  strings  are 
mirrored  in  symbolic  form  as  N,  AN,  ZZZ,  etc.,  in  the  Format 
Register,  and  the  contents  of  this  register  are  matched  for 
suitability  with  the  Format  Dictionary.  Matches  with  the  Format 
Dictionary  are  listed  as  Candidate  Index  Terms. 

The  final  steps  in  the  MAI  process  involve  the  Natural  Lan¬ 
guage  Data  Base  (NLDB ) .  The  NLDB  is  a  file  of  the  approved  DDC 
subject  terms,  the  natural  language  extracts  (for  which  these 
authorized  terms  are  substituted)  and  a  hierarchy  relationship 
among  the  subject  terms. 

The  terms  generated  by  the  MAI  process  are  matched  against 
the  NLDB.  Those  that  match  an  authorized  term  are  passed  through 
the  data  base;  those  that  match  an  equivalent  or  variant  term 
are  converted  to  the  approved  term.  Both  of  these  cases  go  for¬ 
ward  to  eventual  posting  on  the  appropriate  inverted  file.  Those 
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MAI  terms  which  do  not  match  are  reviewed  by  a  subject  analyst 
and  all  worthwhile  terms  are  added  to  the  NLDB  either  as  new 
authorized  vocabulary  or  as  "lead-ins"  to  authorized  terms. 
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ON-LINE  SYSTEM  DETAILED  DESCRIPTION 


ON-LINE  SYSTEM  DETAILED  DESCRIPTION* 


The  On-Line  System  is  logically  divided  into  two  major  di¬ 
visions.  They  are:  (1)  The  Communications  Monitor,  which  inter¬ 
faces  with  the  UNIVAC  1100  operating  system's  communications 
handlier,  and  (2)  The  Application  Controller,  which  handles  the 
user  oriented  tasks.  The  system  is  mapped  as  a  "multi-banked" 
program. 

The  separation  of  communications  and  applications  makes 
the  application  portion  practically  independent.  Conversely, 
the  communications  division  is  independent  of  the  application. 

The  vital  links  between  the  two  divisions  are  the  activity 
data  transfer  buffers,  terminal  identifier  words  and  control 
words  which  direct  each  division.  A  description  and  discussion 
of  the  communications  monitor  follows. 

A.  COMMUNICATIONS  MONITOR 

The  Communications  Monitor  handles  all  actions  concerning 
communications,  i.e.,  terminal  traffic  control,  message  verifi¬ 
cation  and  code  conversion,  retransmission,  terminal  acknowl¬ 
edgments,  terminal  component  control,  cassette  read/write,  asyn¬ 
chronous  dial-up  operation,  and  identifying  transmission  prob¬ 
lems  (line  and/or  terminal). 

The  Communications  Monitor  continues  to  interrogate  the 
terminals  until  input  is  received.  The  Communications  Monitor 
will  request  action  from  the  Application  Controller  to  perform 
a  function  when  input  is  received.  When  input  is  received  from 


*From  Ref.  17,  Chapter  III. 


the  terminal,  the  Communications  Monitor  clears  the  common  buffer 
area,  code  converts  the  message  into  this  area  and  extracts  the 
hardware  identification  from  the  message  and  places  it  into  the 
common  buffer  controls  area  with  a  code  denoting  input  present. 
Once  this  action  is  completed,  the  Communications  Monitor  con¬ 
tinues  the  polling  cycle  for  more  data. 

When  the  request  is  completed  by  the  Application  Controller, 
the  response  is  placed  in  the  common  buffer  area  with  the  hard¬ 
ware  identifications  and  code  denoting  type  of  response  in  the 
buffer  control  area.  The  Application  Controller  can  then  proc¬ 
ess  another  user  request,  if  present  in  the  buffer. 

The  Communications  Monitor  verifies  the  terminal  hardware 
identification  and  interprets  the  code  denoting  type  of  response. 
It  then  converts  the  message,  prepares  the  line  protocol  and 
forwards  the  response  to  the  terminal. 

The  Communications  Monitor  then  follows  with  a  poll  request 
to  the  terminal  for  acknowledgment  of  receipt.  It  is  after  re¬ 
ceipt  of  -the  acknowledgment  from  the  terminal  that  the  Communi¬ 
cations  Monitor  clears  the  input/output  buffer  areas  before 
processing  any  request  from  the  next  terminal. 

B.  DETAILED  DESCRIPTION  OF  THE  APPLICATION  CONTROLLER 

The  Application  Controller  is  responsible  for  interfacing 
the  Communications  Monitor  and  the  user-oriented  tasks,  direct¬ 
ing  the  loading/storing  of  the  nonresident  user  DBanks,  data 
bank  access,  logging,  collection  of  statistical  information, 
and  initialing  the  appropriate  functions  requested  by  user 
commands . 

To  understand  more  fully  the  operation  of  the  Application 
Controller,  the  components  that  comprise  the  Controller  will 
be  discussed  first;,  secondly,  the  operation  and  information 


flow;  and  finally  the  security  checks  that  are  made  during 
the  operation  of  the  system. 

1 .  Components  of  the  Application  Controller 

The  Application  Controller  is  composed  of  10  major  com¬ 
ponents.  They  are: 

a.  System  Initialization 

b .  Traffic  Control 

c.  System  Control  Tables  -  System  Piles 

d.  Data  Tables 

e.  System  Subroutines 

f.  Application  Function 

g.  Activity  Core  Buffers 

h.  Data  Save/Work  Areas 

i.  Data  Bases 

Although  there  are  prime  security  checks  in  the  system,  redun¬ 
dant  checks  are  made  throughout  the  major  components  to  ensure 
there  is  not  unauthorized  access  to  classified  data.  A  brief 
discussion  of  each  component  follows : 

a.  System  Initialization:  Performs  all  of  the  prelim¬ 
inary  housekeeping  chores  required  to  being  up  to 
the  system.  If  any  vital  check  fails,  control  is 
returned  to  the  Communications  Monitor  at  the  er¬ 
ror  return. 

b.  Traffic  Control:  Directs  the  loading  and  storing 
of  the  user’s  DBank  (program),  interprets  and  sends 
control  words  to  the  Communications  Monitor,  initiates 
and  terminates  terminals,  makes  all  user  worker 

file  assignments,  validates  commands,  and  file  checks. 

c.  System  Control  Tables:  Are  used  by  the  controller 
to  operate  the  system  and  for  security  checking. 

The  tables  are  used  primarily  by  traffic  control. 


d. 


Data  Tables :  These  tables  are  used  by  the  functions 
to  validate  field  names,  codes,  constants,  etc. 

The  prime  reasons  for  creating  this  element  were 
to  eliminate  duplication  and  to  reduce  assembly 
time  because  most  of  the  entries  are  static. 

e.  System  Subroutines/Processes:  Are  used  to  eliminate 
duplication  of  coding  and  control  certain  critical 
tasks  required  by  the  functions. 

f.  Functions :  The  system  will  perform  six  major 
functions.  They  are:  (1)  Inverted  File  Search; 

(2)  Direct  File  Search;  (3)  Display  Direct  File 
Items,  Accession  Lists,  and  Miscellaneous  Status 
File;  (4)  Sort  Accession  Lists;  (5)  Order  Products; 

(6)  Remote  Batch  Input. 

g.  Activity  Core  Buffers:  The  system  has  a  core  buffer 
reserved  for  each  activity.  The  program  DBank  is 
read  in  from  mass  storage  into  the  appropriate  buffer 
for  execution.  Classified  and  unclassified  ter¬ 
minals  do  not  share  the  same  core  buffers. 

h.  Data  Save/Work  Areas:  There  are  mass  storage  files 
assigned  to  the  system  which  are  subdivided  into  logi¬ 
cal  files.  These  files  are  assigned  to  the  terminal 
as  required. 

i.  Data  Bases:  The  DTIC  store  of  information  is  com¬ 
prised  primarily  of  past,  present,  and  planned 
research  and  engineering  efforts  and  consists  of 
such  data  fields  as: 

•  Report  Limitation  -  Work  and  report  security,  etc. 

•  Control  Information  -  Contract  number  and  number 
codes,  etc. 
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•  Identifying  Information  -  Keywords,  descriptors, 
report  titles,  and  scientific  and  technology 
codes 

*  Technical/Management  Information  -  Funding  and 
text  data. 

Many  data  fields,  varying  from  fixed  one-character  codes 
to  variable  free-flow  text  data  fields,  are  contained  in  the 
data  banks.  File  sizes  of  the  various  data  banks  vary  from 
several  hundred  unique  records  to  over  half  a  million. 

Each  data  bank  consists  of  two  distinct  files.  The 
Data  File  CDirect  File)  is  the  master  file  and  contains  all 
the  information  pertinent  to  each  reportable  work  document. 

To  facilitate  retrieval  of  these  documents,  certain  entries 
from  each  document  (search  terms  and  retrieval  points)  are 
extracted,  collected,  and  sorted  into  sequence  to  make  the  In¬ 
dex  File  (Inverted  File).  Associated  with  each  search  term 
on  the  Index  File  is  the  accession  number  of  each  document 
from  which  it  was  extracted,  thus  producing  a  comprehensive 
index  for  rapid  search  purposes. 

No  on-line  file  maintenance  is  permitted  at  this  time. 
Both  Data  and  Index  Files  within  each  data  bank  are  updated 
on  a  scheduled  cycle  basis.  During  this  load,  two  sets  of 
pointer  tables,  one  for  each  file,  are  created  to  locate  the 
data  in  mass  storage  during  the  search  or  display. 

2  .  Description  of  the  Operation/ Informati on  Flow 

a.  System  Initialization  -  During  the  System  startup, 
the  Communications  Monitor  passes  control  to  the 
Application  Controller  so  that  the  vital  housekeeping 
chores  can  be  done.  The  following  tasks  are  attempted 
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1.  Verification  of  the  System  Control  Tables  - 
A  check  is  made  to  see  that  each  system  contains 
the  same  number  of  entries.  The  second  check  is 
made  to  verify  that  each  terminal  entry  is  in  the 
same  relative  position  in  each  table. 

2.  Stores  a  dummy  program  DBank  in  the  classified 
and  unclassified  DBank  save  files.  These  DBanks 
are  read  into  core  for  terminal  initialization. 

3.  Data  base  files  are  assigned.  Indicators  are 
set  for  the  files  that  are  assigned. 

4.  The  inverted  and  direct  file  pointer  tables 
are  loaded  to  core. 

5.  A  subset  of  the  master  user  address  and  con¬ 
tract  file  is  loaded  to  a  mass  storage  file.  The 
list  that  governs  the  loading  of  the  subset  of  the 
file  is  contained  within  the  program.  This  file  is 
used  for  Field-of-Interest-Register  (FOIR)  validation 
and  terminal  classification  verification. 

6.  The  inverted  file  work  areas  are  assigned  to 
each  activity. 

7.  The  activity  log  files  are  assigned. 

8.  An  appropriate  log  entry  will  be  made. 

If  there  are  no  critical  failures,  control  is  returned 
to  the  Communication  Monitor  via  the  normal  return. 

b.  Contingency  Registration  -  There  is  a  contingency 
routine  for  each  activity  which  allows  the  system 
to  terminate  in  an  orderly  manner  once  a  fatal  er¬ 
ror  is  detected  by  the  UNIVAC  1100  Operating  System. 
The  only  nonfatal  error  for  the  application  acti¬ 
vities  is  the  test  and  set  conflict.  Control 
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is  returned  to  the  test  and  set  instruction  after 
a  wait  of  one  thousandths  of  a  second.  Contin¬ 
gency  registration  occurs  the  first  time  each 
activity  is  given  control  by  the  Communications 
Monitor . 

User  Initialization  -  Each  terminal  application  area 
must  be  initialized.  This  action  is  taken  only  at 
the  request  of  the  Communications  Monitor.  If  the 
controller  cannot  initiate  the  application  area  for 
the  terminal,  an  appropriate  log  entry  will  be  made 
and  the  Communications  Monitor  will  be  notified  via 
a  predetermined  Code  Word  (CW).  The  following  ac¬ 
tions  are  required  to  initialize  the  applications 
area  for  a  terminal: 

(1)  The  hardware  identifier  word  sent  by  the  Moni¬ 
tor  is  validated  against  the  pointer  table  identifier 
words.  If  there  is  no  match,  the  error  is  logged, 
and  an  appropriate  CW  is  returned  to  the  Monitor. 

(2)  The  activity  indicator  in  the  pointer  table 
is  checked  to  see  if  the  activity  is  correct. 

The  classification  is  also  checked  to  see  if  the 
terminal  is  unclassified. 

(3)  The  CW  is  validated  and  if  legal,  the  appro¬ 
priate  action  is  taken.  At  this  time,  the  CW  must 
specify  terminal  initialization.  The  check  is 
made  in  the  master  control  table  for  the  site. 

(4)  If  another  user  is  in  core,  the  (program) 

DBank  is  stored,  and  a  dummy  (program)  DBank  is 
read  to  core.  This  is  a  complete  overwrite.  The 
I/O  packet  is  checked  to  see  that  the  correct  num¬ 
ber  of  words  is  read  to  core. 
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(5)  The  data  save/work  areas  for  the  terminal 
are  assigned.  Each  area  is  cleared  to  zeros 
just  prior  to  being  assigned  to  the  terminal. 

(6)  The  terminal’s  user  code,  terminal  identi¬ 
fier  word,  pointer  table  index  value,  activity 
buffer  address,  six-digit  field-data  terminal 
identifier  are  stored  in  the  (program)  DBank  area. 

(7)  The  status  is  set  to  active  in  the  terminal 
MCT.  There  is  still  a  lock  on  the  user  which 
inhibits  the  execution  of  commands  until  the 
program  identification  is  made. 

(8)  The  first  page,  along  with  a  request  to 
enter  the  site  identifier,  is  sent  to  the  termi¬ 
nal.  The  site  identifier  entered  by  the  user 

is  compared  against  the  one  stored  in  the  program 
DBank.  If  there  is  no  match,  the  user  is  given 
a  second  chance.  If  there  is  no  match  the  second 
time,  the  terminal  is  terminated  and  an  appropri¬ 
ate  security  error  logged.  Before  the  terminal 
can  be  activated,  the  user  must  telephone  DTIC 
and  request  activation.  A  match  of  site  identi¬ 
fiers  clears  the  command  inhibit  switch  and  allows 
the  user  to  begin  normal  operation.  An  unclassified 
user  must  enter  the  correct  terminal  ID  the  first 
time  or  the  site  is  terminated. 

d .  Normal  Operation 

(1)  The  terminal  user  keys  in  commands/data  and 
transmits  the  buffer.  The  buffer  is  transferred 
by  the  Communications  Monitor  to  the  Application 
Controller  via  the  mutually  accessible  buffer. 

The  appropriate  activity  is  activated. 
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(2)  Whenever  an  activity  in  the  controller  is  acti¬ 
vated,  the  hardware  identifier  word  in  the  data 
transfer  buffer  is  validated.  If  the  hardware 
identifier  is  illegal,  the  error  is  logged  and 

an  appropriate  CW  is  placed  in  the  data  transfer 
buffer.  The  next  user's  request  is  processed. 

(3)  If  the  hardware  identifier  is  validated,  a 
cross  check  is  made  between  the  activity  ID, 
the  terminal  classification,  and  the  activity 
buffer  address. 

(4)  The  control  word  in  the  data  transfer  buffer 
is  validated.  If  invalid,  the  appropriate  CW  is 
placed  in  the  data  transfer  buffer,  the  next  user 
is  processed. 

(5)  If  the  control  word  indicates  a  read,  a 
check  is  made  to  determine  if  the  terminal  DBank 
is  in  core.  If  the  referenced  DBank  is  not  in 
core,  the  DBank  in  core  is  rolled  out  to  the 
save  area  and  the  DBank  for  the  referenced  ter¬ 
minal  is  rolled  in.  The  registers  are  loaded 
from  the  register  save  area  in  the  DBank  and 
the  program  control  is  passed  to  the  continu¬ 
ation  address. 

(6)  Read  data  requests  from  the  Application 
Controller  by  application  functions  are  serv¬ 
iced  by  a  single  routine,  which  sends  one  line 
of  data  at  a  time  to  the  requester.  The  only 
exception  is  during  input  processing — the  en¬ 
tire  buffer  is  transferred.  In  both  cases,  each 
character  of  data  is  examined  for  command  de¬ 
limiters.  When  a  delimiter  is  detected  in  the 
data,  an  attempt  is  made  to  assemble  a  legit- 
mate  command,  or  in  the  case  of  the  input 
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function,  a  legitimate  subcommand.  If  the  con¬ 
troller  cannot  assemble  a  legitimate  command,  one 
of  the  following  messages  is  sent  to  the  terminal: 

•  Format  Error  in  the  Command 

•  Syntax  Error  in  the  Command 

•  Illegal  Command/File  Relationship 

The  data  in  the  transfer  buffer  is  overwritten  by 
the  print  message.  The  user  must  now  enter  a 
legitimate  command  for  the  terminal.  If  a  legi¬ 
timate  command  is  detected,  control  is  passed 
to  a  function  entry  point  to  perform  the  requested 
task.  If  no  command  delimiter  is  detected  by 
the  read  routine,  the  data  line  is  passed  on  to 
the  requester. 

(7)  Output  requests  from  the  Application  Con¬ 
troller  are  serviced  by  a  single  routine  which 
moves  the  data  transfer  buffer.  The  hardware 
identifiers  and  the  CW  are  set.  The  Communica¬ 
tions  Monitor  then  transfers  the  message  to 
the  referenced  terminal. 

e .  Terminal  Terminations 

(1)  Normal  Termination:  The  Communications  Moni¬ 
tor  sends  a  CW  which  directs  the  Applications  Con¬ 
troller  to  terminate  a  terminal.  The  work/save 
areas  are  returned  to  a  pool  and  the  appropriate 
status  words  are  set  in  the  master  control  table. 

A  dummy  DBank  is  written  over  the  DBank  in  core 
and  the  event  is  logged. 

(2)  Activity  Termination:  The  Communications 
Monitor  directs  the  controller  to  terminate  each 
active  terminal  assigned  to  the  activity.  In 
this  case,  each  terminal  is  normally  terminated. 
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(3)  The  Applications  Controller  may  also 
terminate  a  site,  activity  or  the  entire  pro¬ 
gram  if  a  critical  error  occurs.  In  this 
event,  the  Communications  Monitor  is  notified 
via  the  CW. 

3 .  Security  Control 

The  prime  security  checks  are  made  in  the  traffic  control 
section.  Commands  are  analyzed  and  a  cross  check  is  made 
between  the  data  base  file  being  referenced  and  the  command 
requested.  However,  many  redundant  secondary  checks  are  made 
to  ensure  that  if  there  is  a  failure  in  the  prime  check,  one 
of  the  secondary  checks  will  prevent  an  unauthorized  access 
to  classified  data.  The  following  security  precautions  are 
taken : 

a.  The  Communications  Monitor  and  the  Applications 
Controller  maintain  separate  activity  assignment 
lists . 

b.  Unclassified  terminals  only  are  assigned  to  a 
specific  activity. 

c.  Classified  and  unclassified  DBank  save  files 
are  separate  cataloged  files.  I/O  packets 
are  generated  by  a  proc  at  assembly  time. 

d.  The  unique  terminal  identifier  word  is  validated 
each  time  data  is  passed  from  the  Communications 
Monitor  and  the  Applications  Controller  which 

in  effect  checks  the  activity  assignment  and 
classification . 

e.  The  terminal  (program)  DBank  is  checked  each 
time  it  is  rolled  into  core.  (Terminal  identi¬ 
fier,  pointer  word,  user  code,  6-digit  field- 
data  site  ID,  etc). 


f.  Commands  are  validated  for:  (1)  Format,  (2) 
Syntax,  and  (3)  File/Command  Relationship.  A 
terminal  must  be  permitted  access  to  the 
referenced  file  and  command. 

g.  The  delimiter  used  in  the  system  is  a  master 
space  or  binary  zero.  The  master  space  is  used 

by  the  operating  system  to  identify  control  state¬ 
ments.  Any  control  statement  entered  as  data  at 
the  terminal  would  conclude  as  an  error  in  the 
command  analyzer. 

h.  Data  Base  Access,  Direct  Files 

(1)  All  access  to  a  direct  file  data  base  is 
made  via  a  fetch  direct  file  item  routine. 

(2)  Classified  and  unclassified  direct  files 
are  separately  cataloged.  The  fetch  routine 
cross  checks  the  activity  number  and  the  classi¬ 
fication  indicator.  It  will  not  read  a  classi¬ 
fied  item  into  an  unclassified  activity. 

(3)  The  item  is  read  to  core  and  a  field  of 
interest  check  is  made  against  a  subset  of  the 
master  user  address  and  contract  (MUAC)  file. 

The  MUAC  file  also  carries  the  terminal  classi¬ 
fication.  The  classification  is  cross  checked. 

If  the  validation  fails  the  item  in  core  is 
overwritten  with  zeros. 

i .  Data  Base  Access,  Inverted  Files 

(1)  The  retrieval  function  controls  all  access 
to  the  inverted  files. 

(2)  The  retrieval  commands  are  analyzed,  and 
if  validated,  the  appropriate  entry  point  to 
the  search  is  taken.  An  additional  check  is 
made  at  the  end  of  the  search.  If  the  activity 
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is  unclassified,  an  additional  level  of  not 
Confidential,  not  Restricted,  and  not  Secret 
is  added  to  eliminate  all  classified  accession 
numbers . 

Terminal  Data  Save/Work  Areas 

(1)  The  data  save/work  areas  are  assigned 
when  the  terminal  is  activated  and  their 
relative  starting  address  is  kept  in  the 
master  control  table.  These  areas  are  cleared 

to  zeros  prior  to  their  assignment  to  a  terminal. 

(2)  Each  access  to  the  file  is  checked  by  a 
routine  to  verify  that  a  read  or  write  into  the 
file  is  within  the  limits  assigned  to  the 
terminal.  The  routines  that  use  the  files  also 
check  to  see  that  the  limit  is  not  exceeded. 
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RESPONSE  TIME  INVESTIGATION 

The  objective  of  this  investigation  was  to  determine 
the  present  system  "response  time"  and  to  determine  the  traffic 
factors  relating  to  it,  so  that  response  time  could  be  pre¬ 
dicted  for  projected  future  traffic  increases. 

Let  us  define  a  "search"  as  consisting  of  a  series  of 
"transactions."  Each  transaction  consists  of  an  input  from  a 
remote  terminal  and  a  response  from  the  computer. 

Response  time  is  defined  as  the  time  between  the  instant 
the  computer  receives  the  input  until  the  instant  that  it 
begins  to  transmit  its  response  to  the  terminal.  Thus,  response 
time  contains  two  components:  (a)  the  time  expended  by  the 
terminal  input  in  queue  within  the  computer  and  (b)  the  time 
expended  by  the  computer  in  processing  the  input. 

It  can  be  shown  that  the  mean  response  time  is 

?  =  ~T=T  (1) 


where 


+  x  =  mean  time  required  to  process  an  input 

p  =  computer  occupancy,  erlangs 

P  =  X  x  (2) 


where  X  =  average  arrival  rate  of  terminal  inputs  at 
the  computer 
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To  investigate  response  time,  the  data  available  in 
DTIC-84  appeared  most  appropriate.  The  last  report  in  this 
document  is  called  Defense  RDT&E  On-Line  System ,  CRT  Utiliza¬ 
tion  Report  by  User  Type  for  the  Period  01  Deo  79  thru  SI  Deo 
79.  Of  particular  interest  were  the  columns  labeled  " Wall 
Time  Active"  and  "System  Processing  Wall  Time".  It  was  assumed 
that  the  former  referred  to  the  terminal  "connect"  time  and 
the  latter  referred  to  the  actual  time  expended  by  the  computer 
in  processing  the  transactions  required  for  a  search.  (As  will 
be  seen  later.  System  Processing  Wall  Time  is  not  defined  in 
this  way . ) 

Each  page  of  the  report  was  analyzed  with  the  following 
result : 


TABLE  I 


PROCESS  TIME/  CONNECT  TIME/  NO. 
PAGE  NO.  TERMINALS  SEARCH  (sec)  PROCESS  TIME  SEARCHES 


1 

33 

90.1 

17.1 

731  9 

2 

32 

62.9 

26.4 

4925 

3 

22 

46.6 

21  .7 

3591 

4 

1  5 

41  .9 

18.7 

3907 

5 

6 

54.5 

38.1 

518 

6 

9 

62.1 

18.3 

1772 

Terminals  on 

whereas  those 

the 

on 

first  five  pages  were  on 

page  6  were  on  contractor 

government 

premises . 

premises 

Twenty- 

nine  of  the  thirty-three  on  page  1  were  DTIC  in-house  terminals. 
The  column  in  Table  I  labeled  "process  time  per  search" 


consists  of: 


SYSTEM  PROCESSING  WALL  TIME 

NO.  OP  SEARCHES 


expressed  in  seconds. 

From  Table  I,  it  is  evident  that  page  1  differs  from  the 
other  pages  in  having  a  higher  process  time  per  search.  It 
was  concluded  that  terminals  on  page  1  might  be  used  for  batch 
processing,  which  time  might  be  included  in  the  total.  How¬ 
ever,  at  this  stage  of  the  investigation,  it  was  not  deemed 
appropriate  to  attempt  a  separation.  Accordingly,  the  mean 
process  time  per  search  is 

y  =  90.1*7319+62.9*4925+46.6*3591+41.9*3907+54.5*518+62.1*1772 

(7319+4925+3591+3907+518+1772) 

=  65.3  sec/search  (3) 


From  the  DTIC-84  Report,  Defense  RDT&E  On-Line  System^ 
Total  of  System  Responses  Reoeived  During  Month  of  Deos  it  was 
found  that  there  were  a  total  of  201667  responses  received 
during  December  and  that  13-5$  of  the  responses  occur  during 
the  busy  hour  on  the  average.  (The  busy  hour  occurs  at  14:30) 

It  is  assumed  that  the  term  "response"  coincides  with 
our  definition,  "transaction".  Thus,  the  mean  number  of  trans 
actions  per  search  is 


-  _ _ 201667  _ 

n  (7319+4925+3591+3907+518+1772) 

.  201667  —no 

22032  y 


(4) 


Accordingly,  the  mean  process  time  per  transaction  is,  from 
(3)  and  (4) 


It  should  now  be  possible  to  calculate  p,  the  computer  occu¬ 
pancy.  From  the  the  DTIC-84  report.  Monthly  Summary  of  Termi¬ 
nal  Responses  (DEC),  it  is  evident  that  there  are  approximately 
2000  responses  during  a  peak  hour.  Thus, 

,  _  2000  _  «  ,  ,  . 

A  -  3&00  -  O,55o  transactions  per  second,  and 
p  =  X  x  =  0.556  •_  7*1  =  3*9  erlangs  (6) 

If  there  are  not  parallel  processors  handling  this  load 
(there  should  be  at  least  six),  then  we  must  conclude  that 
the  data  used  for  x  is  not  processing  time,  as  assumed,  but  is 
probably  the  "response  time",  as  we  have  defined  it.  Thus, 
t  =  7.1  sec.  rather  than  x  as  originally  assumed.  This  can 
be  confirmed  further  by  noting  that,  if  the  response  time  is 
exponentially  distributed  (which  is  likely),  then  the  CDF  for 
response  time  can  be  shown  to  be 

P(x<t)  =  l-e"t/x  (7) 

From  the  DTIC-84  report.  Distribution  of  System  Processes 
by  Time  Interval  Required  for  26  Nov  79 ,  and  equation  (7)  with 
t  =  7«1  seconds,  the  following  comparison  can  be  made.  Entries 
in  the  table  are  P(x<t). 


TABLE  II 

DISTRIBUTION  OF  SYSTEM  RESPONSE  TIME 


T  i  me 

5 

10 

1  5 

20 

25 

30 

>  30 

P(x  <t) 
DTIC-84 

0.413 

0.787 

0.894 

0.936 

0.958 

0.968 

0.032 

Eq.  (7) 

0.506 

0.755 

0.879 

0.940 

0.970 

0.985 

0.01  5 
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This  indicates  a  reasonably  close  agreement  between  the 
DTIC  report  data  and  equation  (7)  with  regard  to  the  distri¬ 
bution  of  response  time. 

Since  we  have  some  verification  of  the  hypothesis  that 
the  time  reported  as  system  processing  wall  time  is  response 

time  as  defined  here,  it  is  appropriate  to  use  the  data 
obtained  together  with  equations  (1)  and  (2)  to  evaluate  the 
true  processing  time  and  then  to  predict  how  response  time 
varies  with  traffic. 

We  will  assume  that  the  response  time  for  the  busy  hour 
is  equal  to  the  average  response  time  as  computed  in  (5)* 

(In  practice  it  may  be  greater).  With  this  assumption,  from 
equations  (1)  and  (2) 


x 

x  =  - — 

1+Xx 


7.1 


l+( 


2000 

3S00 


)  (7-1) 


=  1.44  sec 


(8) 


p  =  X  x  =  jg-"  1.44  =  0.8  erlangs.  (9) 

Discussions  with  personnel  using  interactive  terminals 
indicate  that  a  response  time  delay  of  more  than  a  few  seconds 
is  annoying  to  the  operator.  In  general,  delays  are  perceived 
by  the  operator  to  be  much  longer  than  they  are.  One  operator 
estimated  a  delay  to  be  one  minute  when,  in  fact,  it  was 
about  10  seconds.  Thus,  an  average  delay  of  the  order  of  7 
seconds  is  considered  at  the  threshold  of  acceptability. 

Note  that  while  the  average  response  time  is  7*1  seconds,  the 
response  time  delay  distribution  of  Table  II  applies.  Thus, 
there  will  occasionally  be  much  greater  delays. 

Using  the  results  that  have  been  derived,  and  with  NOV- 
DEC  79  as  a  baseline,  equation  (1)  can  be  used  to  forecast 
response  times  based  on  a  10#  yearly  traffic  increase. 


The  results  are  shown  in  Table  III. 


TABLE  III 


T  i  me 


Forecast  Mean 

Response  Time 


Baseline  Period 


7.1  sec 


1  year  later 

2  years  later 


44.3 


12.0 


The  rapid  increase  in  response  time  results  from  the  fact 
that  the  processor  is  approaching  100$  occupancy.  Equation  (9) 
indicates  that  the  computer  is  presently  80$  loaded  during  the 
busy  hour .  As  traffic  increases  the  computer  may  become  over¬ 
loaded  during  the  busy  hour,  which  will  lead  to  very  large 
response  times.  Table  III  is  carried  to  the  point  where  com¬ 
puter  occupancy  is  still  less  than  100$. 

The  present  system  uses  polling  to  solicit  messages  from 
terminals.  Polling  is  appropriate  when  a  group  of  terminals 
share  a  multi-point  (party-line)  circuit.  If  individual  lines 
or  dial  up  service  is  used,  there  is  no  advantage  in  using 
polling;  the  mean  polling  time  adds  directly  to  the  mean 
response  time  reported  here.  Thus,  the  response  time  perceived 
by  a  user  will  exceed  the  response  times  of  Table  III. 

The  results  that  have  been  obtained  regarding  response 
time  are  based  on  certain  assumptions  which  appear  to  be 
corroborated  by  other  data.  If  the  results  are  valid,  they 
indicate  that  the  DTIC  system  response  time  operation  is  mar¬ 
ginal  from  the  viewpoint  of  the  user.  It  will  continue  to 
deteriorate  as  traffic  grows,  unless  steps  are  taken  to  reduce 
the  processing  per  transaction.  This  can  be  achieved  by: 


(a)  Reducing  the  processing  time  per  transaction 
with  improved  software  or  faster  processors; 

(b)  Reducing  the  impact  of  transaction  arrivals 
by  using  parallel  processors; 

(c)  Eliminating  the  polling  protocol  for  all 
except  multi-point  circuits.  Reduce  the  number 
of  terminals  per  multi-point  circuit. 

It  is  recommended  that  measurements  be  made  during  the 
busy  period  of: 

(a)  Processor  utilization 

(b)  Processing  time  per  transaction 

(c)  Mean  number  of  transactions  in  queue, 
awaiting  processing. 

These  measurements  can  be  used  to  either  verify  or 
correct  the  results  obtained  here. 

In  addition  to  the  response  time  investigation,  work 
was  begun  on  an  investigation  of  AUTODIN  II  as  a  user  network 
for  DTIC  services.  At  the  time  the  effort  was  suspended 
insufficient  data  was  collected  for  reporting  purposes. 
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